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ANNOUNCEMENT 

The  educational  public  is  entitled  to  know  the  reasons  for 
establishing  a  new  educational  periodical,  the  place  it  is  designed 
to  occupy,  and  the  purpose  it  is  intended  to  serve.  It  is  true  that 
no  assumption  of  a  "mission"  however  happily  expressed  will 
weigh  beside  the  revealing  substance  of  the  periodical  itself. 
Like  a  plank  in  a  political  platform  i^  will  have  merely  the  interest 
of  suspense  until  practice  squares  with  promise.  To  the  hard- 
headed  reader,  it  may  even  seem  but  an  artifice  to  beguile  him 
from  his  customary  caution.  Yet  it  is  equally  true  that  the 
possession  of  a  clearly  conceived  plan  may  reasonably  be  re- 
quired of  those  who  thus  presume  to  enter  a  field  already  so  fully 
occupied. 

We  feel  that  we  have  such  a  plan.  The  Journal  of  Educa- 
tional Research  will  be  devoted  to  the  uses  which  have  been 
made  and  are  capable  of  being  made  of  the  results  and  methods  of 
investigation.  It  will  emphasize  applications  rather  than  abstrac- 
tions, and  practice  rather  than  theory.  It  will  not  avoid  the 
theoretical  altogether,  and  it  will  present  some  technical  articles. 
But  such  articles  will  be  most  welcome  when  they  have  obvious 
practical  implications.  Research  for  the  sake  of  research  we 
shall  leave  for  others.  What  uses  the  teacher  and  supervisor 
have  made  or  may  make  of  the  findings  of  the  experimentalist, 
what  methods  are  transferable  from  the  laboratory  to  the  class- 
room and  office,  what  workable  means  of  meeting  common  needs 
have  been  developed  under  actual  school  conditions — these  will 
be  our  chief  concern.    We  shall  seek  contributions  not  only  from 
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the  leaders  in  research  but  also  from  their  followers,  the 
practical  school  people. 

And  the  school  people  are  likely  to  contribute  handsomely. 
Current  periodicals  reveal  that  the  number  of  them  who  have  the 
true  research  spirit  and  the  ability  to  report  their  findings  effec- 
tively is  increasing.  New  types  of  teacher-training  have  exalted 
a  fact  basis  for  instructional  and  administrative  procedure ;  and 
the  introduction  of  better  school  records  and  new  means  of 
measurement  have  made  such  a  fact  basis  possible.  What  the 
facts  are  and  what  comes  of  them — the  methods  that  work  and 
the  devices  that  succeed — may  be  told  so  that  others  may  derive 
friendly  lessons  for  their  guidance. 

Theory  has  outrun  practice  in  our  educational  writings. 
Since  scales  and  standardized  tests  began,  ten  years  ago,  to 
afford  new  instruments  of  precision,  a  new  language  has  de- 
veloped— a  language  whose  vocabulary  and  idiom  are  strange. 
Statistics  has  come  upon  the  scene,  providing  a  powerful  method 
of  analysis,  but  at  the  same  time  assuming  to  a  disquieting  degree 
the  possession  on  the  part  of  the  reader  of  knowledge  and  a  type 
of  thinking  which  he  often  lacks.  Results  are  quite  generally 
abstract,  and  "tentative  conclusions"  are  often  merely  specu- 
lative. Some  of  us  wonder  whether  all  this  is  necessary — 
whether  a  writer  may  not  be  scientific  without  being  impractical 
or  profound  without  being  obscure — whether  the  time  has  not 
come  when  some  of  these  results  may  be  restated  in  usable  form 
— whether  we  do  not  now  possess  the  materials  for  studying 
some  problems  long  enough  and  hard  enough  to  reach  conclusions 
which  are  fundamental  and  satisfactory. 

The  attempt  will,  therefore,  be  to  permit  practice  to  catch 
up  with  theory.  The  Journal  will  endeavor  to  exemplify  sound 
theory  and  it  is  hoped  that  its  technic  will  be  adequate.  But 
we  believe  its  theory  and  technic  will  be  best  exemplified  when 
they  are  employed  in  the  reporting  of  practical  investigations 
and  in  the  formation  of  practical  results. 

In  its  statistical  presentations,  the  Journal  will  assay  to  set 
a  standard  for  clear,  simple  treatment.  Where  unfamiliar 
terms  or  processes  are  used  it  will  be  our  policy  to  define  and 
explain  them.  As  a  part  of  this  general  plan  a  series  of  statisti- 
cal articles  will  appear  shortly  which  will  attempt  to  deal  in  an 
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understandable  way  with  the  terms  and  processes  in  current 
usage  in  educational  writings. 

Although  the  Journal  of  Educational  Research  is  pub- 
lished for  the  University  of  Illinois  it  is  a  national  magazine.  Its 
board  of  associate  editors  and  its  staff  of  contributing  editors 
represent  many  sections  of  the  country.  Manuscripts  are  being 
accepted  for  publication  and  will  continue  to  be  accepted  regard- 
less of  the  affiliations  of  their  authors.  The  National  Associa- 
tion of  Directors  of  Educational  Research — an  organization  hav- 
ing bureaus  in  universities,  in  city  school  systems,  and  in  one 
state  department — has  adopted  the  Journal  as  its  official  organ. 
These  are  evidences  that  the  Journal  will  by  no  means  be  local 
in  character. 

Not  only  will  it  aim  to  appeal  to  educational  people  every- 
where but  it  will  also  be  hospitable  to  educational  questions  of 
every  type.  Indeed  its  scope  in  this  respect  will  be  as  broad  as 
education  itself.  For  convenience,  however,  six  major  fields 
have  been  recognized,  and  corresponding  to  each  is  an  associate 
editor. 

Leonard  P.  Ayres  will  have  charge  of  child  accounting; 
W.  W.  Charters  will  give  attention  to  curriculum  analysis  and 
derivation;  S.  A.  Courtis  will  edit  manuscripts  relating  to 
school  supervision  and  the  organization  of  bureaus  of  research; 
Walter  S.  Monroe  will  deal  with  educational  tests  and  measure- 
ments ;  George  D.  Strayer  will  direct  the  policy  of  the  magazine 
as  to  educational  finance,  buildings  and  building  programs, 
records  and  reports ;  and  Lewis  M.  Terman  will  have  control  of 
the  department  of  intelligence  testing.  E.  J.  Ashbaugh,  Secretary 
of  the  National  Association  of  Directors  of  Educational  Re- 
search, is  also  an  associate  editor.  He  will  be  responsible  for 
the  section  of  the  magazine  devoted  to  the  affairs  of  the  Associa- 
tion, 

From  one  point  of  view  no  time  could  be  less  auspicious  than 
the  present  for  launching  this  venture.  The  scarcity  and  high 
price  of  paper  combine  with  labor  shortage  and  unrest  in  the 
printing  and  binding  trades  to  produce  a  condition  bordering 
upon  chaos.  Many  magazines  are  suspending  publication,  and 
most  others  are  limiting  their  output.     Under   these  circum- 
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stances  the  editors  and  publishers  cannot  at  present  be  as  Hberal 
as  they  would  like  to  be. 

From  another  point  of  view  however  the  occasion  is  pecu- 
liarly favorable.  There  are  unusual  accumulations  of  good 
material  seeking  an  outlet.  On  the  one  hand  the  facilities  for 
publication  have  been  scanty  during  the  war,  and  on  the  other 
hand  investigations  have  never  been  more  numerous.  Old  preju- 
dices have  been  abandoned.  Precedent  has  meant  less  than 
ever  before.  A  new  sense  of  values  has  been  created,  and  time- 
honored  processes  have  been  challenged.  Some  of  them  have 
stood  the  test  and  have  been  retained ;  others  have  been  rejected ; 
while  still  others  have  been  modified  and  redirected.  Those 
who  have  been  engaged  in  this  movement  have  something  to 
say,  and  they  have  been  unable  to  say  it. 

Whether  under  such  circumstances  a  magazine  having  these 
avowed  aims  can  meet  the  needs  of  the  hour  will  depend  not 
only  upon  the  validity  of  the  aims  but  also  upon  the  steadfast- 
ness with  which  they  are  maintained.  Believing  that  our  reasons 
are  good  reasons,  that  the  place  we  seek  to  occupy  should  be  more 
fully  occupied,  and  that  our  purposes  are  worthy,  estimating  the 
chances  of  success  or  failure,  and  convinced  that  success  is  cer- 
tain if  we  keep  faith  with  our  intentions,  we  present  to  the  educa- 
tional public  this  first  number  of  the  Journal  of  Educational 
Research. 

B.  R.  Buckingham. 
Editor. 


EDUCATIONAL  RESEARCH 

S.  A.  COURTIS  AND  P.  C.  PACKER 

Public  Schools,  Detroit,  Michigan 

Many  articles  have  appeared  on  the  subject  of  educational 
research,  but  the  movement  for  the  use  of  scientific  methods  in 
education  has  grown  so  rapidly  that  already  much  of  what  has 
been  written  is  out  of  date.  It  is  fitting,  therefore,  that  in  the 
very  first  number  of  a  journal  devoted  exclusively  to  the  field, 
the  attempt  should  be  made  to  reformulate  in  terms  of  present 
day  activities  the  functions  of  research  in  education,  to  define 
its  scope,  and  to  describe  the  organization  of  an  ideal  department 
of  educational  research  in  a  large  city  school  system. 

The  point  of  view  of  the  authors  of  this  article  can  be  most 
readily  understood  if  education  is  conceived  as  a  war  waged  by 
society  to  gain  control  of  its  own  evolution.  Many  years  ago 
the  human  race,  having  won  certain  of  the  preliminary  skirmishes 
against  natural  obstacles  in  earth  and  sky  and  sea,  undertook  to 
conserve  its  hard  won  gains  by  creating  schools  which  should 
pass  down  to  the  next  generation  all  that  seemed  to  be  of  per- 
manent value  in  the  experience  of  the  race.  That  is,  at  first 
education  was  a  defensive  warfare  merely.  Its  chief  goal  was 
to  conserve ;  to  preserve  unchanged.^ 

With  the  development  of  human  thought  and  philosophy  has 
come  a  clearer  vision.  Today  men  understand  as  never  before 
that  the  whole  spirit  and  destiny  of  a  people  are  molded  and 
directed  by  the  work  done  in  the  schools.  Today  in  education 
society  is  beginning  to  conduct  an  aggressive  warfare.  Educa- 
tion now  aims  not  only  to  conserve  the  best  of  the  past,  but  to 
improve  upon  the  present  and  to  provide  for  a  progressive  future. 
Today  the  discovery  and  exact  description  of  the  instincts,  capaci- 
ties, and  tendencies  of  children,  the  invention  of  more  efficient 
methods  of  instruction,  the  use  of  more  certain  methods  of  direc- 
tion, and  the  achievement  of  better  forms  of  organization  of 
human  energy  for  carrying  forward  the  collective  struggle  for 
world  betterment  are  seen  by  many  to  be  the  supreme  and  persis- 
tent battle  in  man's  ever  widening  and  progressive  conquest  of 
nature. 

*  Well  illustrated  in  China  under  the  old  regime. 
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But  nature  is  perverse.  In  each  age  she  marshals  her  forces 
anew.  Old  instincts  ever  tend  to  find  lawless  expression  under 
each  set  of  new  conditions.  Just  as  the  Hollander  must  repair 
his  dikes  constantly  to  keep  the  sea  back  from  the  lands  already 
reclaimed,  just  as  further  gains  make  greater  and  greater  de- 
mands upon  engineering  skill  and  knowledge,  so  each  age  has  its 
own  educational  adjustments  to  make.  The  educational  warfare 
is  a  real  war.  By  frontal  attack,  by  surprise  raids  from  air  and 
sea,  by  sapping  and  mining,  the  struggle  goes  constantly  on.  If 
one  age  breaks  down  a  feudal  system  which  blocks  the  way  to 
progress,  the  next  develops  factory  production  and  industrial 
slavery.  The  nations  have  gone  to  war  to  make  the  world  safe 
for  democracy,  but  if  the  schools  do  not  raise  a  breed  of  men  who 
will  put  democracy  into  industry  and  at  the  same  time  make  a 
v;ise  use  of  the  increase  in  the  wealth  and  leisure  time  that  will 
result,  the  sacrifices  of  civilization  are  likely  to  have  been  in 
vain.  The  true  battle  front  of  progress  in  increasing  measure 
is  to  be  sought  in  our  schools. 

If  now  we  ask  ourselves  how  a  successful  general  goes  about 
it  to  zvin  his  battle,  we  find  that  one  very  important  element  to  be 
considered  is  the  efficiency  of  his  research  department.  His 
advance  listening  posts,  his  scouting  parties,  his  aeroplanes,  main- 
tain a  continuous  survey  of  the  enemy  and  of  all  his  activities. 
The  general  must  know  his  opponent's  strength  and  the  disposi- 
tion of  his  forces,  he  must  watch  his  movements  and  anticipate 
his  attacks.  His  success  depends  upon  his  ability  to  detect  and 
interpret  every  change  in  the  situation,  whether  that  change 
spells  trouble  or  opportunity. 

Let  us  call  this  watchful,  continuous  collection  of  facts  the 
"survey"  function  of  the  intelligence  department.  It  is  the  first 
of  the  two  great  functions  of  all  research. 

It  is,  however,  by  no  means  the  only  function.  For  instance, 
suppose  the  survey  work  of  the  intelligence  department  of  an 
army  is  well  done.  That  is,  suppose  the  commanding  officer  has 
at  his  command  reliable  and  reasonably  complete  information  in 
regard  to  his  opponent,  and  decides  upon  offensive  action.  He 
makes  his  plans,  and  his  men  and  guns  move  forward.  Imme- 
diately a  new  type  of  research  work  begins.  It  is  now  the  su- 
preme duty  of  his  intelligence  department  to  keep  the  general  in 
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constant  touch  with  what  happens  on  every  front.  His  plans 
fail  here,  succeed  there.  At  one  part  of  the  line  his  armies  move 
over  into  new  ground  and  new  conditions.  At  another,  the 
enemy  develops  unexpected  strength.  If  there  is  to  be  eventual 
success,  the  general  must  be  able  to  modify  his  plans  on  the  basis 
of  the  progress  of  the  battle.  He  must  be  able  to  judge  at  every 
instant  how  well  he  is  suceeding.  Coordination  of  effort  and 
consolidation  of  gains  are  directly  dependent  upon  this  "judg- 
ment" activity,  and  this  in  turn  upon  the  efficiency  of  his  research 
department. 

Let  us  call  this  second  type  of  service  the  appraisal  function 
of  research.  In  its  essential  nature  all  research,  as  the  name 
implies,  is  simply  the  organized,  careful,  and  systematic  search 
for  facts,  but  it  is  well  to  emphasize  the  different  purposes  for 
which  research  may  be  carried  on.  "Survey"  and  "appraisal" 
merely  stress  the  "before"and  "after"  aspects  of  the  relation  of 
research  to  executive  action.  No  matter  how  great  the  execu- 
tive genius  which  plans,  or  administers,  achievement  will  ever, 
except  by  chance,  be  conditioned,  on  the  one  hand,  by  the  com- 
pleteness and  accuracy  of  the  information  upon  which  plans  are 
based  and,  on  the  other,  by  the  extent  to  which  they  are  modified 
to  fit  actual  conditions  as  these  are  revealed  through  executive 
action. 

If  now  we  turn  from  the  battle  field  to  the  classroom,  the 
exactness  of  the  parallel  must  be  apparent.  The  superintendent 
as  executive  head  of  the  school  system  is  constantly  called  upon 
to  plan  and  to  execute.  He  has  need  to  know  the  facts;  he  has 
even  greater  need  to  know  the  effects  of  his  decisions.  In  edu- 
cational warfare,  we  are  as  yet  fighting  blindly  and  in  the  dark. 
The  intelligence  service  is  not  well  organized.  Too  often  appar- 
ent success  at  one  part  of  the  line  appears  later  as  a  detriment  to 
the  general  progress.  For  enduring  success  there  must  be  active 
and  continuous  survey  work  and  even  more  active  and  more  per- 
sistent appraisal  of  the  effects  of  executive  action. 

That  is,  an  ideal  superintendent  in  an  ideal  school  system 
would  have  as  two  of  his  fundamental  rules  of  action,  the  follow- 
ing; 

1.     Except  under  the  pressure  of  the  need  for 
immediate  action  I  will  never  plan  an  executive 
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policy  or  action  without  a  preliminary  survey  to 
secure  the  facts  which  will  make  my  planning  in- 
telligent, and 

2.  Will  never  perform  an  executive  act  with- 
out immediately  taking  steps  to  collect  the  facts 
which  enable  me  to  appraise  the  effect  of  the  act. 

In  such  an  ideal  school  system  under  such  an  ideal  superin- 
tendent, there  would  be  need  for  a  large  department  of  educa- 
tional research  and  the  department  would  be  kept  very  busy. 

It  is  not  enough,  however,  to  have  an  intelligent  apprecia- 
tion of  the  two  functions  of  research.  Every  school  man  needs 
also  a  deep-seated  conviction  as  to  their  importance.  Perhaps 
this  can  be  gained  best  from  an  illustration  from  biology. 

In  the  study  of  any  living  organism  from  a  one-celled  animal 
to  man  himself,  two  types  of  nervous  mechanisms  are  found ;  the 
sensory  and  the  motor.  The  first  transmits  inward  the  stimula- 
tions derived  from  the  environment;  the  other  transmits  out- 
ward to  the  muscles  those  stimulations  which  result  in  motor 
activity. 

Take  the  case  of  a  cat,  for  instance.  Suppose  the  control- 
ling intelligence  of  a  cat  receives  from  its  department  of  the  in- 
terior a  report  that  supplies  are  running  low;  in  other  words, 
that  it  is  hungry.  Suppose  further  that  the  cat  then  directs 
its  research  department  to  survey  the  landscape  to  secure  the 
data  upon  which  to  base  a  plan  for  obtaining  the  desired  food, 
and  that  soon  the  nose  reports  that  a  mouse  is  smelled,  the  ears 
that  a  mouse  is  heard,  the  eyes  that  a  mouse  is  seen. 

The  cat  is  now  in  possession  of  the  necessary  facts.  She 
formulates  a  policy;  she  will  catch  the  mouse.  The  executive 
orders  are  issued,  the  muscles  contract,  the  cat  jumps  for  her 
prey. 

The  research  department  now  begins  to  perform  the  appraisal 
functions.  The  nose  and  ears  and  eyes  measure  the  distance 
and  report  that  the  legs  jumped  short;  that  further  action  is 
necessary  if  the  goal  is  to  be  achieved. 

In  the  meantime,  let  us  suppose  that  the  mouse  has  been  doing 
some  surveying  on  his  own  account  and  decides  that  he  has  im- 
portant business  elsewhere.     His  executive  actions  are  at  once 
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reported  by  the  cat's  research  agents.  Her  original  plan  is  then 
modified,  the  length  and  rapidity  of  her  jumps  are  changed  until 
the  mouse  is  caught. 

Returning  to  the  educational  situation  once  more,  we  find  that 
in  the  original  one-room  private  school  in  early  colonial  days,  the 
master  of  the  school  performed  every  educational  function.  He 
gathered  his  own  facts,  he  formulated  his  own  policies,  he  acted 
upon  them,  and  he  appraised  the  effect  of  his  actions,  even  as 
many  one-room  school  teachers  do  to  this  day.  But  as  public 
education  grows  to  be  a  great  municipal,  or  state,  or  national 
system,  this  is  no  longer  possible.  There  has  to  be  division  of 
labor  and  specialization.  Today  the  technic  of  research  de- 
mands special  training  and  undivided  attention,  both  of  which  are 
seldom  possible  for  the  average  superintendent.  Research  func- 
tions must  be  delegated  to  a  special  department. 

An  important  question  to  be  considered  is  the  magnitude  and 
importance  of  the  work  of  such  a  department.  The  answer  is  to 
be  found  in  our  biological  parallel.  For  in  nature  there  have 
been  two  types  of  development:  plants  and  animals.  In  most 
plants,  the  sensory  or  research  functions  have  undergone  almost 
no  development  from  those  of  the  original  call,  while  the  rrtotor 
or  executive  functions  make  up  the  main  life  activities  of  the 
plant.  Thus  a  tree  is  a  large  and  complex  organism  which 
carries  on  energetically  for  many  years  activities  of  surprising 
magnitude,  yet  its  sensory  mechanism  is  but  little  more  developed 
than  that  of  the  elemental  cell  from  which  it  has  evolved. 

In  the  animal  kingdoms,  however,  the  development  of  the 
sensory  mechanism  has  paralled  the  complexity  of  the  structural 
and  motor  elements.  In  animals,  life  itself  depends  upon  the 
proper  coordination  of  the  functioning  of  the  two  types  of 
mechanisms.  The  plant  organization  is  admirable  as  a  per- 
manent adjustment  to  a  fixed  environment,  but  the  animal  organi- 
zation permits  greater  freedom,  greater  range  of  action,  and  thus 
makes  possible  the  attainment  of  higher  levels  of  progress. 

If  now  we  examine  a  large  school  system,  such  as  that  of 
New  York  City,  which  spends  in  one  year  $45,000,000  on  its 
schools,  and  whose  superintendent  is  called  upon  to  direct  the 
activities  of  an  army  of  35,000  teachers  and  900,000  children, 
and  if  we  ask  ourselves  which  type  of  organization  it  most 
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resembles,  the  judgment  must  be  that  it  is  the  vegetative  type. 
It  is  the  executive,  the  administrative  organization  which  has 
developed,  not  the  research  or  sensory  mechanism.  The  survey 
and  appraisal  activities  upon  which  executive  actions  are  based 
are  carried  on  today  as  in  the  beginning,  on  the  basis  of  opinion 
merely.  It  is  true  a  beginning  has  been  made.  Since  1912 
there  has  been  a  department  of  reference  and  research,  but  the 
total  amount  spent  in  New  York  City  during  the  school  year 
1918-1919  for  research  was  less  than  a  tenth  of  one  per  cent  of 
the  total  budget.  In  no  sense  does  either  survey  of  appraisal 
play  a  vital  part  in  determining  executive  action. 

What  is  true  of  New  York  City  is  true  also  of  our  educa- 
tional life  in  general.  We  have  developed  education  as  a  vegeta- 
tive and  permanent  adjustment  to  a  fixed  environment,  when  all 
our  experience  and  all  our  reasoning  proclaim  in  stentorian  tones 
that  the  environment  is  not  fixed,  that  the  present  adjustment  of 
education  to  society  is  not  permanent,  that  the  needs  of  this  day 
and  of  every  day  to  come  is  for  progress,  progress,  and  yet  more 
progress.  In  other  words,  the  superintendent  of  any  of  our 
large  city  systems  has  about  as  much  chance  of  making  his 
schools  serve  adequately  the  purposes  in  society  which  we  now 
see  they  ought  to  serve,  as  a  cat  would  have  of  catching  a  mouse 
if  its  research  mechanism  were  dissected  out  and  replaced  by  the 
elementary  sensory  machinery  of  some  of  the  lower  animals  from 
which  the  cat  has  evolved. 

The  conclusion  is  clear  and  cannot  be  avoided.  Educational 
research  is  destined  to  develop  until  it  parallels  in  magnitude  and 
importance  the  administrative  phase  of  education.  Whenever 
the  activities  of  any  department  attain  such  size  and  complexity 
that  there  must  be  division  of  labor,  the  creation  of  every  adminis- 
trative agent  must  be  paralled  by  the  creation  of  a  corresponding 
research  agent,  except  where  the  two  functions  can  be  combined 
in  a  single  person.  Thus  the  superintendent  will  necessarily 
combine  within  himself  both  the  research  and  the  execu- 
tive functions.  He  must  be  able  to  initiate,  direct  and  under- 
stand research  work  and  methods  in  every  field,  as  well  as  to 
formulate  policies  and  administer  the  same  in  every  field.  That 
is,  the  ideal  superintendent  will  be  as  much  the  director  of  educa- 
tional research  in  his  school  system  as  he  is  now  the  chief  execu- 
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tive  officer.  And  there  is  probably  no  more  fitting  training  for 
him  who  aspires  to  be  superintendent  than  several  years  of 
service  in  the  various  fields  of  research. 

Few  school  men  yet  realize  that  educational  research  means 
something  more  than  the  mere  giving  of  a  few  trivial  standard 
tests  in  the  grades;  that  education  will  be  a  science  only  when 
scientific  attitudes  and  scientific  methods  pervade  every  phase 
of  educational  work.  Perhaps  it  would  be  more  nearly  correct 
to  say  that  few  have  ever  thought  of  education  except  in  the 
narrow  terms  of  their  own  special  work.  It  will  come  as  a  sur- 
prise to  many  that  in  a  fully  developed  school  system,  educational 
research  would  be  carried  on  by  some  fourteen  departments  or 
divisions,  each  with  a  responsible  head  and  each  with  research  or 
clerical  assistants.  Several  of  the  departments  would  need  a 
large  stafif  of  specialists. 

If  we  attempt  to  list  these  departments  in  logical  order  we 
must  begin  with  (1)  the  department  of  sociological  research. 
The  superintendent  needs  an  officer  and  a  properly  equipped  de- 
partment whose  sole  duty  it  to  survey  society  and  report  its  struc- 
ture, its  condition,  its  tendencies,  its  needs.  At  present  social 
pressure  must  reach  high  tension  before  it  ope;-ates  with  certainty 
through  the  school  board  and  the  public  press  to  influence  the 
activities  of  the  superintendent.  In  the  future  the  schools  must 
lead,  not  follow.  Educational  policies  must  be  based  upon  ade- 
quate knowledge  of  the  social  situation,  past,  present,  and  future. 
Nor  is  it  enough  that  the  superintendent  make  such  adjustments 
in  organization,  studies  and  methods  of  teaching  as  seem  to  him 
to  produce  the  right  effect  upon  society.  There  must  be  an  accu- 
rate and  scientific  appraisal  of  the  eflFect  of  the  school's  output 
upon  society.'  It  is  to  this  sociological  appraisal  that  we  must 
look  for  the  final  word  in  regard  to  every  change  made  in  the 
educational  process.  Survey  and  appraisal  in  the  field  of  educa- 
tional sociology  are  thus  the  ?.lpha  and  the  omega  of  education 
itself.' 

■  Meriam,  J.  L.  "Measuring  school  work  in  terms  of  life  out  of  school," 
School  and  Society,  5 :  339-42,  March  24,  1917. 

*  Hanus,  P.  H.,  and  Gaylord,  H.  D.  "Courtis  arithmetic  tests  applied  to 
employees  in  business  houses,"  Educational  Administration  and  Supervision, 
3:505-20,  November,  1917. 


12  JOURNAL  EDUCATIONAL  RESEARCH        Vol.i.No.i 

The  second  department  would  study  (2)  the  methods  of  list- 
ing and  keeping  track  of  the  children  to  be  educated  (census) 
and  of  getting  them  to  school  and  of  keeping  them  there  as  long 
as  their  presence  in  school  is  profitable.  Few  cities  have  any  ade- 
quate knowledge  of  where  or  under  what  social  conditions  their 
children  live.*  Still  fewer  m.ake  such  studies  of  social  changes 
that  they  can  predict  the  population  shifts  in  even  the  immediate 
future.  Yet  it  is  upon  such  data  alone  that  wise  purchases  of 
school  grounds  can  be  made,  or  an  adequate  building  program 
framed.  Similarly,  school  officers  have  kept  attendance  records 
for  years,  but  the  methods  employed  have  been  so  imperfect,  and 
so  little  attention  has  been  paid  to  the  results  that  even  today  few 
adequate  attendance  data  exist.  Most  school  men,  as  well  as  the 
general  public,  would  be  astounded  if  the  real  facts  in  regard  to 
absences,  transfers,  and  removals  could  be  presented  in  graphic 
form.  Still  less  has  been  done  in  determining  causes  of  variable 
attendance  and  in  devising  corrective  measures.  Attendance 
research  is  a  wide  field  that  reaches  from  the  home  and  society  on 
the  one  hand  to  the  classroom  and  the  teacher  on  the  other.  Upon 
the  solution  of  certain  of  the  problems  in  this  field,  depends 
directly  the  efficiency  of  work  in  several  other  departments. 

The  third  field  of  research  covers  (3)  the  problems  of  organi- 
zation and  administration.  Because  of  our  present  ignorance, 
for  many  years  to  come  any  scheme  of  organization  must,  at  best, 
be  but  a  compromise  between  desirable  but  conflicting  ends.  In 
the  absence  of  scientific,  experimental  data,  convention  is  usually 
the  determining  factor.  Changes  come  slowly.  Yet  change, 
progress  in  educational  ideals,  demand  at  once  corresponding- 
change  in  forms  and  methods  of  organization.  These  in  turn 
react  upon  every  form  of  educational  activity.'  At  present  the 
research  bureaus  of  many  cities  are  struggling  with  the  problem 
of  appraising  such  recent  adoptions  as  the  platoon  organization, 
sectioning  on  the  basis  of  intelligence  tests,  and  the  like.  Prop- 
erly functioning  departments  of  administrative  research  would 

*Ayres,  L.  P.  Child  accounting  in  the  public  schools.  (Cleveland  Educa- 
tion Survey.)     Cleveland :    Survey  Committee  of  Cleveland  Foundation,  1915. 

•  Strayer,  G.  D.  and  Bachman,  F.  P.  The  Gary  Public  Schools:  Organiza- 
tion and  Administration.    New  York:    General  Education  Board,  1918. 


Jan.  1920  EDUCATIONAL  RESEARCH  13 

have  supplied  experimental  data  to  justify  the  form  of  organiza- 
tion adopted  and  to  guide  the  efforts  at  appraisal. 

The  adoption  of  a  definite  educational  policy  and  a  definite 
form  of  organization  would  seem  to  demand  (4)  buildings  and 
grounds  to  correspond.  Yet  research  in  this  field  is  little  more 
than  an  idea,  a  dream."  At  Gary,  an  educational  ideal  deter- 
mined the  form  and  arrangement  of  the  building  and  grounds, 
but  exceptional  as  this  is  in  American  education,  few  data  can 
be  shown  which  are  a  real  aid  in  determining  the  best  size,  shape 
and  arrangement  of  rooms,  halls,  etc.,  to  achieve  a  given  educa- 
tional objective.  However,  a  beginning  has  been  made  here 
also  and  standards  for  measuring  existing  buildings  (an 
appraisal  activity)  should  lead  directly  to  architectural  experi- 
mentation. A  department  of  architectural  research  will  be  the 
eventual  outcome,  and  a  member  of  the  research  staff  to  devote 
his  whole  time  to  this  field  is  immediately  essential  to  an  adequate 
department  of  research  in  a  large  city  school  system. 

It  is  not  enough  to  build  schoolhouses  educationally  adapted 
to  a  given  program.  They  must  be  kept  in  proper  condition. 
Lighting,  cleaning,  ventilating,  heating,  repairing,  etc.,  condition 
use  as  much  as  structure,  perhaps  more.^  Yet  the  attention 
given  such  details  in  most  school  systems  is  Of  the  crudest  sort. 
As  educational  research  expands,  as  the  search  for  the  condition- 
ing factors  of  educational  efficiency  is  pushed  farther  and  farther, 
it  is  inevitable  that  the  day  will  come  when  a  special  department 
will  be  created  to  deal  with  experimental  work  of  this  particular 
kind.  Let  it  be  called  (5)  a  research  department  for  mainte- 
nance activities  and  janitorial  service.' 

•  No  high  school  building  has  been  designed  about  the  educational  activi- 
ties that  are  to  go  within  it  except  in  the  roughest  sort  of  way.  For  instance, 
a  high  school  building  in  one  of  the  large  cities  of  the  country,  constructed 
within  the  last  three  years,  has  lavatory  space  adequate  for  2,400-2,600  pupils, 
but  the  shortage  of  classrooms  is  so  great  the  building  is  overcrowded  with 
2,000  students. 

*  Brkowitz,     J.     H.      Standardisation     of     medical     inspection     facilities. 
(United  States  Bureau  of  Education  Bulletin  No.  2,  1919.) 

*  Thorndike,  E.  L.  and  Ruger,  T.  J.  "The  effects  of  outside  air  and 
recirculated  air  upon  intellectual  achievement  and  improvement  of  school 
pupils:  a  second  experiment,"  School  and  Society,  4:260-64,  August  12,  1916. 
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Closely  connected  with  buildings  and  maintenance  are  (6) 
problems  centering  around  equipment  and  supplies.  The  deter- 
mination of  what  equipment  should  be  purchased,  what  supplies 
should  be  used,  belongs  primarily  to  the  department  of  instruc- 
tional research,  but  once  these  questions  are  decided  there  arise 
problems  of  purchasing  the  needed  supplies  and  equipment,  of 
distributing  them  through  the  system,  and  of  keeping  them  in 
good  repair.  Here  again  the  plans  of  the  best  of  superinten- 
dents and  the  efforts  of  the  best  of  teachers  and  supervisors  are 
often  seriously  handicapped  by  the  failure  to  give  to  problems  of 
purchase,  distribution,  and  maintenance,  the  educational  atten- 
tion they  deserve.  Efficiency  here  does  not  mean  the  purchase 
of  the  cheapest  material  from  the  lowest  bidder,  nor  the  reduc- 
tion of  the  expense  of  distribution  or  maintenance  to  the  lowest 
possible  level.  Only  the  research  man  whose  business  it  is  to 
trace  evident  results  to  their  fundamental  causes  can  appreciate 
the  number  and  importance  of  the  research  problems  in  this 
field.  They  demand  the  existence  of  a  divisional  organization  to 
deal  with  them." 

A  group  of  research  problems  whose  importance  is  being 
recognized  more  and  more  widely  each  year  are  (7)  those  which 
have  to  do  with  the  selection,  classification,  assignment,  and 
promotion  of  both  the  personnel  of  the  educational  corps,  and  of 
the  children."  As  education  becomes  more  and  more  scientific 
every  educational  agent,  from  cleaning  women  to  teachers,  from 
stenographers  to  superintendent,  is  chosen  more  and  more  on  the 
basis  of  fitness  for  his  particular  job.  Fitness  is  measurable  and 
careful  selection  by  appropriate  tests  saves  the  waste  and  disaster 
caused  by  the  unfit.  "Promotion  on  the  basis  of  merit"  presup- 
poses that  merit  can  be  determined  in  some  more  objective  and 
impersonal  way  than  by  mere  opinion.  As  yet,  however, 
scarcely  a  beginning  has  been  made.  Anyone  can  enumerate 
more  problems  which  press  for  solution  than  the  wisest  man 
could  solve  in  many  years  of  work. 

'  Boston,  Mass :  Finance  commission.  Report  on  the  Boston  School  Sys- 
tem, 191  r. 

"  Saam,  Theodor.  "Intelligence  testing  as  an  aid  to  supervision,"  Ele- 
mentary School  Journal,  20:26-32,  September,  1919. 
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Even  more  clearly  recognized  is  the  need  for  careful  deter- 
mination of  the  original  nature  of  children.  It  is  evident  that 
for  the  protection  of  the  school,  as  well  as  of  the  child  himself, 
each  new  scholar  must  be  given  a  searching  diagnostic  physical, 
mental,  educational,  moral,  and  social  examination,  immediately 
upon  his  entrance  into  the  school  system  and  that  these  examina- 
tions must  be  repeated  at  sufficiently  short  intervals  to  detect 
causes  of  trouble  before  they  have  a  chance  to  produce  serious 
effects.  The  proper  classification,  assignment,  and  promotion 
of  children  are  functions  so  important  in  education  that  they  call 
for  a  large  and  complex  organization  to  perform  them  in  any  ade- 
quate manner.  The  inefficiency  of  our  present  machinery  is 
daily  becoming  more  apparent. 

It  is  only  a  question  of  time  before  the  same  department  will 
be  extended  to  include  the  examination,  selection,  assignment, 
and  promotion  of  teachers,  janitors,  and  every  other  type  of 
educational  workers.  Not  every  person  who  completes  success- 
fully a  normal  training  course  is  fit  to  be  a  teacher.  Indeed  little 
is  known  about  what  elements  of  training  and  character  deter- 
mine teaching  ability,  while  the  selection  of  janitors,  engineers 
and  other  persons  whose  work  has  to  do  with  the  operation  of 
schools  has  scarcely  been  recognized  as  yet^as  an  educational 
problem.  In  many  schools  the  ideals  and  refinement  of  class- 
room work  are  daily  being  offset  by  contacts  in  basement  and 
playground  with  vulgar  and  immoral  janitors  and  engineers. 
Each  of  these  has  a  particular  work  to  do,  and  the  work  can  be 
done  efficiently  only  by  some  one  who  is  both  trained  and  adapted 
to  the  work  he  has  to  do.  Research  problems  of  the  greatest 
importance  to  society  center  in  this  field. 

One  of  the  largest  and  most  complex  divisions  is  (8)  the 
department  of  instructional  research,  and  many  are  the  types  of 
problems  which  would  occupy  the  research  men  specializing  in 
this  field.  Wherever  in  the  school  system  there  is  classroom 
work,  there  will  be  found  problems  of  standards,  courses  of 
study,  comparative  efficiencies  of  different  types  of  textbooks, 
equipments,  and  methods  of  work.  Measurement  of  the  effects 
of  supervision  is  almost  a  field  in  itself,  as  are  also  the  problems 
arising  in  normal  training,  teacher  training,  technical  training, 
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etc.,  the  education  of  typical  children,  the  brilliant,  the  blind,  the 
deaf,  the  crippled,  the  mentally  deficient,  and  all  the  other  types 
of  children  who  depart  widely  from  the  average  child.  Every 
one  of  these  fields  has  its  peculiar  problems  which  can  be  solved 
only  by  one  who  is  thoroughly  familiar  with  the  special  technic 
of  the  field,  yet  the  instructional  element  is  a  common  factor 
tying  all  together  into  a  single  department. 

Another  important  division  of  research  is  that  which  has  to 
do  with  (9)  problems  of  health  education.  It  is  known  definitely 
that  physical  health  conditions  mental  efficiency,  but  the  Ameri- 
can public  is  just  awakening  to  the  fact  that  the  health  habits  of 
children,  the  hours  and  conditions  of  sleep,  the  amount  and  quality 
of  food,  the  amount  of  healthful  recreational  exercise,  are  vital 
elements  in  educational  efficiency  and  must  sooner  or  later  be 
brought  under  social  control.  In  the  meantime  the  entire  range 
of  problems  covering  the  relation  between  physical  and  mental 
ability,  and  physical  and  mental  growth,  offers  almost  a  virgin 
field  in  research! 

Still  another  distinct  field  of  research  is  to  be  found  in  ( 10) 
cost  accounting  and  the  problems  of  educational  finance.  Re- 
search problems  of  the  proper  relation  between  taxation  and 
public  wealth  of  relative  costs  of  administration,  supervision,  and 
teaching,  of  optimum  versus  minimum  values,  and  a  host  of 
similar  questions  press  for  solution.^^ 

Mention  must  also  be  made  of  the  research  problems  found  in 

(11)  vocational  guidance  and  continuation  schools;  of  those  in 

(12)  adult  education  and  Americanization  work  just  now  in 
the  public  eye;  of  those  connected  with  the  work  of  (13)  pre- 
serving suitable  records  of  the  achievements  of  the  school  system, 
of  preparing  reports  and  statistics  for  publication,  and  of  con- 
ducting publicity  campaigns  for  the  enlightenment  and  education 
of  the  community.  Finally  there  must  be  (14)  pure,  scientific 
research,  the  development  of  new  technical  methods  of  measure- 
ment, new  tests,  new  devices,  and  new  organization  of  existing 
science.     There  must  be  the  search  for  the  natural  laws  under- 

"  Bachman,  F.  P.  and  Bowman,  Ralph.  The  Gary  Public  Schools:  Costs 
for  School  Year  1^^13-1916.    New  Yorn:    General  Education  Board,  1918. 
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lying  the  teaching-learning  process,  and  there  must  be  also  the 
appraisal  of  the  effect  of  all  the  research  work  outlined  above. 

One  of  the  problems  growing  out  of  the  development  of 
research  departments  is  that  of  the  relation  of  such  departments 
to  the  school  board,  to  the  superintendent,  and  to  other  school 
departments.  It  is  evident  that  primarily  research  departments 
are  merely  special  organizations  to  which  the  superintendent  has 
delegated  specific  powers  and  functions  and  that  they  are  acting 
for  him  and  under  his  direction  and  control.  However,  in  as 
much  as  the  superintendent  is  obligated  to  make  a  report  to  his 
board  from  time  to  time  in  regard  to  conditions  in  the  school 
system,  it  should  be  evident  that  all  possibility  of  manipulation 
of  the  results  of  various  research  activities  should  be  eliminated 
as  far  as  possible.  That  is,  the  research  department,  on  request, 
should  report  directly  to  the  board.  This,  however,  means 
divided  responsibility,  while  the  whole  tendency  of  modern 
thinking  in  administrative  methods  is  towards  fixing  responsi- 
bility. The  solution  of  the  difficulty  is  not  apparent,  but  one 
thing  is  certain ;  as  research  methods  gain  in  effectiveness,  con- 
trol would  tend  to  pass  more  and  more  into  the  hands  of  the 
research  men.  That  is,  in  the  future,  an  essential  qualification  of 
an  executive  officer  in  any  field  will  be  that  he  have  the  point  of 
view  which  comes  from  a  thorough  grounding  in  scientific 
methods  and  that  he  be  able  to  organize,  direct,  and  utilize,  re- 
search activities  in  his  field.  If  his  work  becomes  so  heavy  that 
part  of  it  must  be  delegated,  it  is  the  research  functions  that  will 
be  retained.  Cheap  clerical  assistants  can  attend  to  the  details  of 
administration  if  they  are  given  a  minimum  of  oversight  and 
direction,  but  to  recognize  a  problem  before  it  has  been  recognized 
by  others,  to  frame  a  policy  for  dealing  adequately  with  the 
situation,  and  to  appraise  the  effect  of  one's  policy,  calls  for 
constructive,  creative,  effort  of  a  high  order. 

Scientific  measurement  of  educational  products  is  about  ten 
years  old,  but  educational  research  in  its  broadest  sense  is  as  old 
as  education  itself.  Nevertheless,  all  forms  have  shared  in  the 
increased  vigor  and  effectiveness  which  have  come  from  the 
rapid  development  and  statistical  technique  of  instructional  re- 
search.    Organized  research  departments  in  the  modern  sense 
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may  be  said  to  date  from  the  Report  of  the  Committee  on  School 
Inquiry,  New  York  City,  in  1912,  Today  there  are  forty  or 
more  bureaus  of  research  in  university,  state  or  city  systems, 
and  in  scores  of  small  schools  much  research  work  is  carried  on 
by  superintendents  or  other  school  officials.  It  may  be  instruc- 
tive to  ask  how  far  educational  research  in  any  system  approxi- 
mates the  ideal  described  above.  , 

The  city  of  Detroit  established  a  Department  of  Educational 
Research  in  September,  1914,  but  the  person  placed  in  charge 
was  interested  primarily  in  a  single  phase  of  research  work — 
namely,  instructional  research — and  the  activities  of  the  depart- 
ment were  restricted  as  much  as  possible  to  this  field.  Instruc- 
tional research,  however,  leads  to  a  study  of  administrative 
details,  and  the  needs  of  a  big  city  system  produce  a  steady  pres- 
sure for  research  in  every  field  of  work.  The  development  of  the 
research  staff  in  Detroit  has  thus  been  an  erratic  and  chance 
evolution,  rather  than  the  result  of  careful  planning.  Neverthe- 
less, in  September,  1919,  the  research  forces  of  the  city  as  repre- 
sented by  men  specially  trained  in  research  methods  were: 

1.  An  assistant  superintendent  in  charge  of  administrative 
research  (buildings  and  grounds,  budget  making,  organization, 
etc.) 

2.  A  director  of  educational  research  in  charge  of  super- 
visory and  instructional  research  and  miscellaneous  research 
problems. 

3.  An  assistant  director  of  educational  research  in  charge 
of  research  problems  in  secondary  education. 

4.  A  member  of  the  normal  school  faculty  in  charge  of  re- 
search problems  related  to  normal  training  and  the  training  of 
teachers  in  service. 

5.  A  director"  of  the  department  of  special  education  in 
charge  of  mental  testing,  the  psychological  clinic,  and  related 
problems  having  to  do  with  classification,  assignment  and  promo- 
tion. 

Each  of  these  men  has  clerical  and  other  assistants  and  each 
serves  to  direct  the  experiments  and  research  problems  of  super- 

"  Position  unfilled  at  the  opening  of  school,  but  the  work  carried  on  by 
other  members  of  the  department. 
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visors,  principals,  and  teachers  throughout  the  city.  In  addi- 
tion there  are  other  departments  which  do  much  research  work, 
as  the  department  of  records,  pubHcity  and  statistics,  while  the 
Board  of  Education  itself  is  organizing  and  directing  a  general 
survey  of  school  work  which  makes  use  of  and  supplements  the 
regular  research  activities. 

The  total  volume  of  research  throughout  the  city  is  thus  very 
large.  In  the  formal  measurement  of  educational  products 
alone  the  program  calls  for  the  use  of  over  a  million  test  papers 
during  the  year,  while  the  informal  and  practice  tests  in  use  in 
the  city  will  amount  to  half  a  million  sheets  more.  All  this 
means  that  in  five  years  the  movement  for  scientific  methods  has 
so  permeated  the  system  and  touched  the  activities  of  educa- 
tional workers  at  so  very  many  points  that  the  ideal  organization 
and  plans  sketched  above  does  not  lie  in  as  remote  a  future  as  the 
conventional  school  man  of  the  old  type  is  likely  to  imagine. 
Therefore,  the  chief  purpose  of  the  Journal  of  Educational 
Research  is  to  bring  to  school  men  generally  such  a  knowledge 
of  the  practical  workings  of  educational  research  in  the  average 
school  as  will  hasten  the  day  when  the  ideal  shall  have  become 
common  practice. 


THE  USE  OF  INTELLIGENCE  Tf:STS  IN  THE 
GRADING  OF  SCHOOL  CHILDREN 
LEWIS  M.  TERMAN 
Leland  Stanford  Junior  University 
The  early  experiments  with  intelHgence  tests  were  directed 
chiefly  toward  the  better  understanding  of  the  feeble-minded,  and 
even  their  later  development  has  centered  largely  around  their 
use   with   defectives,    delinquents,    and   other   types   of   mental 
deviates.     It  is  becoming  clear,  however,  that  their  greatest  use- 
fulness will  be  found   in  their  universal  application  to  school 
children.     Binet's  "methode  de  luxe"  has  been  so  simplified  that 
any  intelligent  teacher  can  use  it  in  a  way  to  enlarge  greatly  her 
knowledge  of  a  given  child.     The  group  examination  methods 
now  in  process  of  development  may  be  expected  to  add  still  fur- 
ther to  the  popularity  of  intelligence  tests  as  an  aid  in  the  more 
accurate  grading  and  in  the  wiser  educational  guidance  of  school 
children.     "A  mental  test  for  every  child"  is  no  longer  an  un- 
reasonable slogan. 

The  Extent  of  Individual  Differences  in  Intelligence 

Intelligence  tests  have  thrown  into  bold  relief  the  enormous 
individual  differences  in  intelligence  which  obtain  for  any  un- 
selected  group  of  children  of  a  given  age.  These  differences  are 
no  less  striking  than  those  long  known  to  exist  in  the  case  of 
height,  weight,  and  other  physical  traits.  The  following  figures 
illustrate  typical  individual  differences  in  height,  in  ability  to  win 
promotion  in  school,  and  in  intelligence,  and  show  how  similar 
the  extent  and  frequency  of  the  differences  are  in  the  three 
respects. 

table  I.     height  in  c.  m.,  236  boys,  aged  9^^  to  10^^  years. 

(Baldwin) 


Height  in  CM 

119-123 

124^128 

129-133 

134-138 

139-143 

144-148 

149-153 

Percent 

2.1 

11 

22 

29.2 

23.7 

10.2 

1.7 

TABLE  II.       GRADE  LOCATION  OF  1896  UNSELECTED  TEN-YEAR-OLD 
BOYS,  SALT  LAKE  CITY 


Grade 

I 

II 

III 

IV 

V 

VI 

VII 

Percent 

0.7 

4.8 

24 

49.4 

18.6 

2.3 

0.2 
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TABLE      III.       I.      O.'S      OF      83      UNSELECTED      TWELVE-YEAR-OLD 

CHILDREN  * 


L  Q 

66-75 

76-85 

86-95 

96-105 

106-115 

116-125 

126-up. 

Percent 

5 

15 

20.5 

28 

19.5 

11 

0.8 

al.  Q.  is  the  usual  abbreviation  for  intelligence  quotient,  which  is  the  quotient  of 
mental  age  divided  by  actual  age. 

TABLE  IV.       MENTAL  AGE.S  OF  263  ELEVEN-YEAR-OLD  CHILDREN 


Mental  Age 

7  or 

less 

8 

9 

10 

11 

12 

13 

14 

15 

16  or 

more 

Percent 

2.66 

5.32 

9.50 

15.96 

22.81 

14.07 

12.93 

8.36 

5.32 

3.04 

Since  the  grade  of  school  work  which  a  child  is  able  to  do 
depends  chiefly  upon  the  level  of  mental  development  he  has 
attained,  such  individual  differences  as  those  just  noted  for  intelli- 
gence show  the  weakness  of  any  method  of  school  administra- 
tion which  tends  to  advance  the  pupil  on  the_basis  of  chrono- 
logical age.  The  chronologically  old  and  the  chronologically 
young  may  and  often  do  belong  together;  the  mentally  old  and 
the  mentally  young  do  not.  Investigations  show  that  notwith- 
standing the  shifting  which  takes  place  at  the  end  of  each  school 
year,  the  resulting  classification  of  children  has  been  so  far  from 
successful  that,  generally  speaking,  the  lowest  20  or  25  percent 
of  pupils  in  any  grade  belong  mentally  in  a  lower  grade  and  the 
highest  20  or  25  percent  in  a  higher  grade.  Only  the  middle 
50  or  60  percent  are  classified  approximately  where  they  should 
be.  Usually  more  than  15  percent  of  pupils  are  at  least  two 
grades  removed  from  the  one  in  which  they  belong  by  mental 
age. 

The  one  criterion  of  fitness  for  promotion  should  be  ability 
to  meet  the  requirements  of  the  next  higher  grade.  Actually 
this  criterion  is  lost  sight  of.  The  so-called  "retarded"  children 
are  in  reality  usually  from  one  to  three  grades  above  where  they 
belong  by  mental  development ;  the  real  retardates  are  the  under- 
aged  children  who  are  generally  found  from  one  to  three  grades 
below  the  location  which  their  mental  development  would  war- 
rant.    The  dull  child  is  kept  at  tasks  which  are  hopelessly  beyond' 
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his  ability ;  the  child  of  superior  intelligence  lacks  the  mental  and 
moral  stimulus  which  comes  from  intense  application  to  tasks 
commensurate  with  his  ability.  In  other  words,  the  problem  of 
retardation  is  exactly  the  reverse  of  what  it  is  popularly  supposed 
to  be. 

The  failure  of  the  school  to  grade  children  according  to 
mental  ability  is  shown  by  the  overlapping  of  mental  ages  in  the 
different  grades.  The  following  figures  for  certain  first  grade, 
fifth  grade,  and  first  year  high  school  classes  are  typical. 

TABLE  V.       MENTAL  AGE  (3-3  TO  3-11,  ETC.) 


Grade 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

IS 

16 

17 

18 

19 

First 

4 

22 

31 

51 

32 

6 

2 

1 

Fifth 

1 

1 

10 

26 

17 

13 

6 

3 

2 

Ninth 

2 

10 

32 

32 

29 

18 

11 

■f 

It  is  seen  that  not  only  do  first  grade  children  greatly  overlap 
those  of  the  fifth  grade,  and  fifth  grade  children  those  of  the 
first  year  of  high  school,  but  that  the  brightest  child  in  the  first 
grade  has  all  but  reached  a  point  in  mental  ability  corresponding 
to  the  lowest  pupil  in  the  high  school.  The  brightest  of  the  fifth 
grade  pupils  are  above  the  median  mental  level  for  the  first  year 
of  high  school,  and  the  brighest  of  the  first  grade  almost  reach 
the  median  for  the  fifth  grade. 


Desirability  of  Tests  in  the  First  Grade 

The  first  grade  is  the  most  critical.  It  is  there  that  retarda- 
tion scores  its  worst  record,  for  usually  about  one-third  of  the 
pupils  fail  of  promotion  by  the  end  of  the  first  year.  Accord- 
ingly, it  is  especially  important  that  in  the  first  grade  the  raw 
material  with  which  the  school  is  to  work  should  be  correctly 
evaluated. 

By  giving  Stanford-Binet  tests  to  more  than  a  thousand  first 
grade  pupils,  and  by  extensive  supplementary  data  and  follow- 
up  work,  Dickson^  has  thrown  valuable  light  on  the  factors  which 
make   for  the   success  and   failure   of   beginning  pupils.     The 

^  See  his  forthcoming  article  in  one  of  the  early  numbers  of  the  Journal 
entitled  "Intelligence  tests  of  first-grade  children." 
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mental  ages  found  ranged  from  three  years  to  almost  eleven 
years.  The  part  played  by  mental  age  is  indicated  by  the  correla- 
tion, of  0.72  between  mental  age  and  the  quality  of  school  work 
as  rated  by  the  teacher.^  Approximately  90  percent  of  the 
pupils  below  a  mental  age  of  six  years  fail  to  win  promotion. 
Since  approximately  one-third  were  found  to  be  below  this  level, 
we  seem  to  have  a  sufficient  explanation  for  the  "piling  up"  of 
enrollment  in  the  first  grade.  On  the  other  hand,  Dickson  found 
nearly  15  percent  above  the  mental  age  of  seven  and  one-half 
years.  Doubtless  the  large  majority  of  such  children  could 
quickly  be  made  ready  for  the  second  grade,  some  of  them  for 
the  third. 

Our  only  requirement  of  the  entering  child  has  been  that  of 
age,  which  is  beside  the  point.  Our  real  concern  is  with  the 
mental  age.  Every  child  should  be  tested  immediately  upon  school 
entrance,  and  those  too  immature  to  stand  a  reasonable  chance  of 
being  able  to  master  the  work  of  the  first  grade  should  either  be 
sent  home  or  given  work  of  a  pre-primary  nature.  There  is  no 
excuse  for  the  postponement  of  diagnosis  until  the  child  has  be- 
come a  confirmed  failure. 

Dickson's  study  is  not  the  only  one  of  this  kind.  In  Council 
Bluffs,  Providence,  and  several  other  cities,  Stanford-Binet  tests 
have  been  given  in  large  numbers  to  first  grade  children.  The 
results  appear  to  be  in  essential  agreement.  The  child  of  six 
and  a  half  to  seven  years  mental  age  is  usually  able  to  master  his 
work ;  the  child  of  mental  age  five  or  five  and  a  half  is  not. 

Inequality  of  Classes  in  the  Same  Grade 

The  success  of  a  teacher  is  judged  largely  by  the  absolute 
standard  of  work  she  is  able  to  secure  from  her  pupils.  How 
unfair  this  may  be  in  individual  cases  is  illustrated  by  the  follow- 
ing facts  for  five  first  grade  classes  tested  by  Dickson. 

*A  correlation  of  1.00  would  mean  perfect  agreement;  a  correlation  of 
0.00  would  mean  no  agreement  whatever.  A  correlation  of  0.72  is  very  high 
for  this  type  of  relationship.  It  means,  of  course,  that  in  general  the  greater 
the  mental  age  the  better  the  quality  of  the  work. 
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TABLE  VI.       INTELLIGENCE  OF  FIVE  FIRST  GRADE  CLASSES 


Room 

Median 

Median 

Percent 

Percent 

Mental  Age 

LQ. 

below  5}/2 
(mental) 

above  7 
(mental) 

A 

6-0 

87 

31 

10 

B 

5-7 

76 

46 

5 

C 

6-0 

85 

20 

26 

D 

7-2 

108 

14 

60 

E 

7-8 

112 

0 

71 

The  average  mental  age  of  Room  E  was  fully  two  years 
above  that  in  Room  B,  and  the  median  I.  O.  36  points  higher. 
One-third  of  the  pupils  in  Room  A,  and  half  of  those  in  Room 
B,  were  incapable  of  doing  standard  first  grade  work.  The  lack 
of  progress  in  Room  B  was  so  evident  that  the  teacher  was  in 
despair  and  the  superintendent  doubted  her  efficiency. 

Two  fifth  grade  classes  tested  by  Hubbard  yielded  a  contrast 
no  less  striking.  The  pupils  of  one  class,  which  we  will  call  class 
A,  ranged  in  mental  age  from  less  than  ten  years  to  more  than 
fifteen  year ;  those  of  class  B,  from  seven  and  three-fourths  years 
to  fourteen  years.  The  median  mental  age  in  class  A  was  almost 
twelve  years;  that  in  class  B  hardly  more  than  ten  years.  A 
twelve-year  mental  age  is  normal  for  the  sixth  grade,  a  ten-year 
mental  age  for  the  fourth  grade.  In  class  A,  44  per  cent  of  the 
I.  Q.'s  were  110  or  above;  in  class  B  only  10  percent.  In  class 
A,  19  percent  of  the  I.  Q.'s  were  below  90;  in  class  B,  44  percent. 
In  class  A,  the  median  I.  Q.  was  108;  in  class  B,  91. 

The  results  of  the  intelligence  tests  were  abundantly  confirmed 
by  the  corresponding  differences  between  the  two  classes  dis- 
closed by  educational  tests.  Class  A  was  as  far  ahead  of  class 
B  in  addition,  substraction,  multiplication,  division,  reasoning 
ability,  and  spelling  as  in  mental  age. 

As  would  be  expected,  these  two  classes  presented  an  entirely 
different  picture.  The  pupils  in  class  A  were  interested,  alert, 
and  above  the  average  in  industry;  those  of  class  B  were  inert 
and  unresponsive.  The  outlook  for  the  two  classes  is,  of  course, 
very  different.  From  15  to  20  percent  of  the  pupils  of  class  B 
will  never,  with  any  amount  of  instruction,  be  able  to  do  the  work 
of  the  eight  grade  satisfactorily,  and  50  percent  are  too  inferior 
in  endowment  ever  to  complete  a  four  year  course  in  the  average 
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California  high  school.     In  class  A  not  far  from  80  percent 
should  be  able  to  graduate  from  high  school. 

One  might  suppose  that  the  teachers  of  these  classes  would 
have  been  keenly  aware  of  the  intellectual  make-up  of  their 
groups.  They  were  not,  except  in  the  vaguest  sort  of  way.  Each 
teacher  knew  that  she  has  some  bright  and  some  dull  pupils. 
How  bright  and  how  dull  was  not  known.  Without  an  objective 
standard,  such  as  is  furnished  by  mental  tests,  the  teacher  can 
only  judge  a  pupil  by  comparing  him  with  the  average  of  his 
group.    ^ 

Range  of  Intelligence  in  the  First  Year  of  High  School 

Noting  that  one-third  or  more  of  the  pupils  who  enter  high 
school  do  not  remain  to  begin  a  second  year  of  work.  Proctor^ 
decided  to  attack  the  problem  at  its  most  critical  point  by  investi- 
gating the  abilities  of  first  year  students.  He  gave  Stanford- 
Binet  tests  to  about  150  pupils  and  group  tests  (chiefly  Alpha*) 
to  1,349  others.  The  mental  age  scores  ranged  from  barely 
twelve  years  to  nineteen  years,  approximatefy  8  percent  being 
below  fourteen,  and  about  23  per  cent  seventen  years  or  above. 
In  general,  the  school  marks  rose  or  fell  fairly  regularly  with 
mental  age,  although  there  were  individual  exceptions  due  to  in- 
dividual differencs  in  application,  health,  regularity  of  atten- 
dance, etc.  Of  the  pupils  having  an  average  score  of  B-(-,  not 
one  was  below  the  mental  age  of  fifteen.  Two-thirds  of  the 
marks  earned  by  pupils  having  mental  ages  below  fourteen  and 
one-half  were  C  or  lower. 

From  Proctor's  study  it  appears  that  the  standards  of  work 
which  are  maintained  in  the  first  year  of  the  average  California 
high  school  cannot  be  satisfactorily  met  by  pupils  with  a  Stan- 
ford-Binet  mental  age  below  thirteen  years,  and  that  below  the 
mental  age  of  fourteen  the  chances  of  success  are  not  good.  It 
also  appears  that  children  with  an  I.  Q.  below  80  rarely  succeed  in 
entering  a  California  high  school,  and  that  those  with  an  I.  Q. 

*  See  a  forthcoming  article  by  W.M.  Proctor,  "Psychological  tests  as  a 
means  of  measuring  the  probable  success  of  high  school  pupils." 

■•The  group  mental  test  that  was  given  to  about  1,300,000  soldiers  during 
the  war. 
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below  90  rarely  graduate.  A  large  majority  of  those  who  drop 
out  have  an  I.  Q,  considerably  below  100.  The  typical  high 
school  offers  little  work  which  can  be  mastered  by  pupils  of  much 
less  than  average  intelligence. 

Such  findings  raise  the  question  whether  high  school  stand- 
ards are  too  high.  Certainly  if  pupils  with  inferior  ability  are  to 
be  retained,  the  high  school  will  have  to  do  one  of  two  things: 
(1)  lower  the  standard  in  the  present  courses;  or  (2)  add  other 
studies  which  are  easier  while  at  the  same  time  educationally 
worth  while.  It  may  be  that  we  have  judged  the  high  school 
too  largely  by  the  difficulty  pupils  encounter  in  meeting  its  stand- 
ards for  graduation.  Proctor  found  that  70  percent  of  those 
testing  below  95  I.  Q.  failed  in  more  than  half  of  their  studies. 
And  more  than  one-third  of  all  children  test  below  95.  A  nation 
falls  short  of  the  true  ideals  of  democracy  which  refuses  to  fur- 
nish suitable  training  for  a  third  of  its  children  merely  because 
their  endowment  does  not  enable  them  to  complete  a  course  of 
study  which  will  satisfy  the  requirements  for  college  entrance. 
High  schools  at  present  are  in  a  sense  "class"  schools. 

Mental  Age  Standards  for  Grading 

The  average  age  of  school  entrance  in  most  parts  of  the 
United  States  is  not  far  from  6^  years.  Reckoning  on  this 
basis,  the  standard  mental  age  for  the  different  grades  would  be 
as  follows: 

TAKLE  VII.       STANDARD  MENTAL  AGE 

1 6J^  to  7  J-^,  or  approximately    7  years. 

II 73^  "    8J^,  "  "  8  " 

III 8M  "    91^  "  "  9  " 

IV 91/2  "  1034  "  "  10  " 

V WA  "  IVA,  "  "  11  " 

VI 113^  "  123^,  "  12  " 

VII 123^  "  133^,  "  "  13  " 

VIII 133^  "  143^,  "  "  14  " 

High  School  I U}4  "  153^,  "  "  15  " 

Children  who  are  located  in  accordance  with  these  standards 
are  in  the  large  majority  of  cases  found  doing  work  of  average 
quality.  If  the  mental  age  is  much  above  or  below  the  norms 
just  indicated,  the  school  work  is  usually  correspondingly 
superior  or  inferior.    This  statement  is  based  upon  an  analysis  of 
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the  relation  between  mental  age  and  school  success  in  the  case 
of  1,936  California  children.  Of  these  1,936,  120  were  two  or 
more  years  above  the  grade  corresponding  to  their  mental  age. 
Only  19  of  the  120  were  rated  as  doing  anything  like  satisfactory 
work.  Even  in  some  of  these  cases  the  teacher's  judgment  was 
open  to  question.  Among  the  1,936,  there  were  234  located  in 
a  grade  two  or  more  years  below  the  standard  for  their  mental 
age,  and  nearly  all  of  these  were  doing  average  to  very  superior 
work. 

In  setting  forth  the  above  mental  age  standards  for  the  differ- 
ent grades,  it  is  not  implied  that  all  pupils  should  be  graded 
rigidly  according  to  mental  age  or  that  there  should  be  no  over- 
lapping of  mental  ages  in  adjacent  grades.  In  the  first  place,  the 
mental  age  scores  yielded  by  any  scale  are  subject  to  a  certain 
amount  of  error.  In  the  second  place,  the  child's  school  success 
is  determined  in  part  by  factors  other  than  intelligence.  All 
these  limitations  of  the  mental  age  method  of  school  grading 
are  freely  admitted.  It  is  impossible,  however,  to  justify  the 
present  miscellaneous  scattering  of  mental  ages  over  the  differ- 
ent grades.  If  a  child  is  allowed  to  progress  beyond  his  mental 
age,  the  fact  should  be  known  and  there  should  be  a  reason  for 
it.  The  same  rule  should  hold  for  the  child  who  is  not  allowed 
to  advance  as  rapidly  as  his  mental  age  would  seem  to  warrant. 

For  several  years  Stanford  University  students  have  investi- 
gated cases  in  which  a  marked  disagreement  was  found  between 
mental  age  and  the  teacher's  estimate  of  the  child's  intelligence 
or  school  work.  These  studies  have  shown  that  such  disagree- 
ments are  oftener  due  to  the  erroneous  judgment  of  the  teacher 
than  to  any  incorrect  verdict  of  the  test.  In  one  group  of  238 
pupils,  34  discrepancies  worthy  of  study  were  found.  The 
majority  of  these  were  not  large.  In  29  of  the  34  cases  the 
quality  of  the  school  work  as  rated  by  the  teacher  was  poorer 
than  the  mental  age  would  seem  to  warrant.  Where  discrepan- 
cies of  this  kind  occured  they  were  ordinarily  due  to  physical 
defects,  lack  of  application,  emotional  instability,  psychopathic 
heredity,  or  to  such  traits  as  timidity  and  lack  of  self-confidence. 
Exceptional  timidity  especially  has  a  strong  tendency  to  cause  an 
underestimation   of   the   child's   ability.      Discrepancies   in   the 
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Opposite  direction  were  usually  due  either  to  exceptional  mental 
application  on  the  part  of  the  child,  or  to  the  effect  of  vivacity, 
responsiveness,  and  other  favorable  personal  traits  in  influencing 
the  teacher's  judgment. 

One  does  not  need  to  go  far  in  this  line  of  investigation  to 
convince  oneself  that  objective  measures  of  intelligence  are 
needed  to  supplement  and  also  on  occasion  to  correct  the  teacher's 
judgments  regarding  the  intelligence  of  her  pupils. 

Intelligence  Tests  of  School  Laggards 

Notwithstanding  the  many  investigations  which  have  been 
made  of  retardation  in  the  last  decade,  the  number  of  school 
laggards  has  decreased  but  little.  Retardation  cannot  be  prop- 
erly dealt  with  until  its  causes  are  known.  The  supposed  causes 
usually  emphasized  are  physical  defects,  irregular  attendance, 
late  entrance,  poor  home  conditions,  and  lack  of  flexibility  in 
methods  of  promotion.  These  "causes"  are  contradicted  by  the 
findings  of  all  who  have  investigated  the  subject  by  the  use  of 
mental  tests.  Of  Dickson's  first  grade  pupils  who  were  chrono- 
logically eight  years  old  or  older,  68  percent  were  below  80  I.  Q, 
Of  Hubbard's  fifth  grade  pupils  who  were  12  years  old  or  older, 
64  percent  were  blow  80  I.  Q.  Of  174  over-aged  children  tested 
in  the  schools  of  "X"  County,  California,  106  were  below  80  I.  Q. 
Anyone  who  desires  additional  proof  need  only  test  a  large  num- 
ber of  unselected  children  of  a  given  chronological  age,  say  11 
years,  and  note  the  school  progress  which  has  been  made  by  those 
at  each  mental  age.     Table  VIII  is  typical. 

A  table  of  this  kind  offers  the  best  possible  evidence  of  the 
validity  of  a  Binet  test  as  a  measure  of  the  child's  educability. 

Intelligence  Tests  for  the  Gifted 

With  the  aid  of  Mrs.  Margaret  Hopwood  Hubbard,  we  have 
gathered  extensive  data  regarding  59  children,  most  of  whom 
tested  above  140  I.  O.  The  Binet  test  was  taken  merely  as  a 
point  of  departure  for  the  investigation. 

Most  of  these  gifted  children  were  located  in  a  grade  two  or 
three  years  below  that  in  which  they  belonged  by  mental  age. 
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TABLE    VIII.       GRADE     LOCATION    OF    263     ELEVEN-YEAR-OLDS    BY 
STANFORD-BINET  MENTAL  AGE.'     CORRELATION  IS  0.81 


Mental  Age 

Grade 

Total 

I 

II 

III 

IV 

V 

VI 

VII 

VIII 

18 

1 

3 
2 
6 
2 

1 

"  T" 

1 

17 

4 

16      

1 

5 

13 

18 

12 

6 

1 

3 

15          

2 
6 
12 
22 
42 
20 
6 

14 

14 

1 

3 
2 

10 

15 

14 

2 

22 

13 

34 

12 

i 
2 

6 
3 
6 
3 

37 

11. 

60 

10 

42 

9 

2 
5 
1 

25 

8 

1 
1 
1 

1 

14 

7 

5 

6 

1 

5 

1 

Total 

4 

8 

21 

47 

110 

56 

15 

2 

263 

Many  of  them  have  since  received  one  or  more  extra  promotions 
as  a  result  of  the  test,  and  all  such  promotions  have  been  justi- 
field  by  the  results.  Several  were  evidently  languishing  at  a 
level  of  school  work  which  so  far  failed  to  command  their  best 
efforts  as  to  affect  unfavorably  their  whole  attitude  towards 
school  life  and  school  work. 

The  study  further  showed:  (1)  that  these  children  were 
apparently  not  below  the  average  in  general  health;  (2)  that  in 
the  vast  majority  of  cases  the  intellectual  ability  was  general 
rather  than  special  or  one-sided;  (3)  that  their  superiority  was 
also  marked  in  moral  and  personal  traits;  (4)  that  queerness 
and  lack  of  social  adaptability  were  the  exception  rather  than 
the  rule;  and  (5)  that  the  superiority  in  most  cases  showed 
itself  early  in  life  and  had  been  little  influenced  by  formal  instruc- 
tion. Follow-up  tests  of  the  same  children  strongly  suggest 
that  their  superiority  is  likely  to  be  maintained. 

We  must  multiply  indefinitely  our  "opportunity  classes"  for 
bright  children.  Wherever  these  have  been  tried  they  have 
proved  an  immediate  success.  Invariably  the  children  are 
touched  by  new  life  and  inspired  with  new  enthusiasm.     Gifted 

*  Terman,  L.  M.,  The  intelligence  of  school  children.     Boston :  Houghton. 
Mifflin  Company,  1919. 
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children  are  the  nation's  greatest  asset,  one  that  has  not  received 
a  thousandth  part  of  the  attention  it  deserves. 

The  I.  Q.  as  a  Basis  of  Prediction 

Mental  age  is  significant  because  it  can  be  used  largely  as  the 
basis  for  school  grading.  The  I.  Q.  is  significant  for  the  reason 
that  it  enables  us  to  predict  with  some  degree  of  approximation 
what  the  child's  future  development  will  be. 

Of  course,  no  one  supposes  that  the  score  earned  in  an  intelli- 
gence test  is  a  perfectly  accurate  index  of  an  individual's  mental 
status;  or  that  even  if  we  had  a  perfect  measure  of  intelligence, 
the  ratio  between  mental  age  score  and  age  would  necessarily 
remain  absolutely  constant  throughout  growth.  It  is  generally 
recognized  that  feeble-minded,  and  particularly  epileptic  and 
psychopathic  children  are  subject  to  erratic  changes  of  I.  Q.  On 
the  other  hand,  it  is  equally  true  that  for  the  large  majority  of 
children,  the  Stanford-Binet  I.  Q.  shows  a  marked  tendency 
toward  constancy.  In  the  case  of  435  I.  O.  comparisons  of 
earlier  and  later  tests  of  the  same  children  the  coefficient  of 
correlation  was  0.933  Many  of  these  tests  were  separated  by 
intervals  of  three  to  seven  years.  It  was  found  that  the  degree 
of  constancy  was  about  the  same  for  bright,  average  and  dull 
children. 

There  is  nothing  else  about  a  child  as  important  as  the  I.  Q. 
Knowing  this,  it  is  possible  to  forecast  with  some  definiteness 
what  the  grade  progress  will  be  and  what  final  level  of  mental 
development  will  be  attained.  The  probable  error  of  such  pre- 
dictions should  be  established. 

Intelligence  Tests  in  Vocational  and  Educational 

Guidance 

Vocational  guidance  usually  receives  attention  only  on  the 
eve  of  the  child's  departure  from  school.  Thus  restricted,  it 
falls  far  short  of  its  possible  value.  At  every  step  in  the  child's 
progress  the  school  should  take  account  of  his  vocational  possi- 
bilities. 


Jan.  1920  USE  OF  INTELLIGENCE  TESTS  31 

We  have  already  seen  how  frequently  the  school  errs  in  at- 
tempting to  force  children  through  courses  of  study  which  are 
beyond  their  intellectual  capacity,  and  how  futile  and  discourag- 
ing such  efforts  are.  It  is  time  that  the  school  should  ask  not 
only  what  it  would  like  to  do,  but  what  it  can  do,  for  a  given 
pupil.  The  limits  of  a  child's  educability  can  be  fairly  accurately 
predicted  in  the  first  school  year.  By  repeated  tests  these  limits 
can  be  determined  accurately  enough  for  all  practical  purposes 
by  the  end  of  the  child's  fifth  or  sixth  school  year. 

Vocational  guidance  is  not,  and  may  never  be,  an  exact 
science.  Nevertheless,  intelligence  tests  will  be  of  value  even 
if  they  tell  us  nothing  more  than  that  reasonable  success  in  a 
given  vocation  is  or  is  not  compatible  with  the  general  mental 
ability  which  a  particular  individual  possesses.  Investigation  of 
the  ranges  of  intelligence  in  the  different  types  of  vocations  will 
make  this  contribution  possible. 

Preliminary  investigations  indicate  that  an  I.  Q.  below  70 
rarely  permits  anything  better  than  unskilled  labor;  that  the 
range  from  70  to  80  is  preeminently  that  of  semi-skilled  labor, 
from  80  to  100  that  of  the  skilled  or  ordinary  clerical  worker, 
from  100  to  110  or  115  that  of  the  semi-professional  pursuits; 
and  that  above  all  these  are  the  grades  of  intelligence  which  per- 
mit one  to  enter  the  professions  or  the  larger  fields  of  business. 
Intelligence  tests  can  tell  us  whether  a  child's  native  ability  corres- 
ponds approximately  to  the  median  for:  (1)  the  professional 
classes;  (2)  those  in  the  semi-professional  pursuits;  (3)  or- 
dinary skilled  workers ;  (4)  the  semi-skilled  workers ;  or  (5)  un- 
skilled laborers;  and  this  information  is  of  great  value  in 
planning  a  child's  education. 

Suggestions  for  the  Use  of  Mental  Tests 

Teachers  themselves  should  be  encouraged  to  use  mental 
tests.  All  children  above  the  third  grade  should  be  given  a  group 
mental  examination  at  least  every  other  year.  All  who  score 
especially  high  or  especially  low  should  be  given  also  an  individ- 
ual examination  (Binet,  etc.). 

All  pupils  in  the  first  two  or  three  grades  ought  to  be  given 
an  individual  examination.     While  the  task  is  large,  it  is  by  no 
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means  impossible,  and  the  tests  at  this  time  will  be  more  valuable 
than  at  any  other  period  of  the  child's  school  career.  The  aim  of 
the  school  should  be  to  start  right  with  each  child.  It  should 
not  be  satisfied  to  proceed  in  the  dark  in  the  hope  that  mistakes 
will  be  patched  up. 

It  is  easier  to  acquire  a  certain  degree  of  aptness  in  giving 
mental  tests  than  it  is  to  learn  how  to  interpret  their  results. 
The  teacher  or  principal  cannot  give  too  much  study  to  this  part 
of  the  problem. 

The  mental  tests  should  be  supplemented  by  ratings  on 
character  traits  and  by  educational  tests.  Comparison  of  the 
various  kinds  of  data  regarding  a  given  child  will  prove  of  sur- 
passing interest. 

In  conclusion,  it  is  urged  that  in  the  management  of  a  school 
or  a  school  system  the  principal  and  the  superintendent  will  find 
intelligence  tests  an  indispensable  aid  in  the  analysis  of  their 
problems,  for  the  simple  reason  that  these  problems  cannot  be 
dissociated  from  the  quality  of  material  with  which  the  school 
works. 


A  NEW  KIND  OF  SCHOOL  EXAMINATION 

WILLIAM  A.  McCALL 
Teacher/  College,  Columbia  University,  New  York 

There  are  in  the  United  States  about  six  hundred  thousand 
school  teachers.  It  is  a  very  conservative  estimate  that  each 
teacher  gives  on  the  average  twenty  examinations  a  year.  This 
makes  twelve  million  examinations  each  year.  The  time  re- 
quired to  construct,  give,  and  score  each  examination  will  aver- 
age, say,  three  hours.  This  means  that  thirty-six  million  hours 
are  spent  examining  pupils.  The  data  just  given  will  suffice  to 
show  the  enormous  importance  of  examinations.  Without  a 
doubt,  they  are  and  will  be  for  some  time  and  may  possibly 
always  remain  the  most  important  form  of  educational  measure- 
ment. Since  this  is  so,  it  may  seem  that  those  of  us  who  are 
interested  in  educational  measurement  have,  in  our  enthusiasm 
for  constructing  and  standardizing  tests,  neglected  the  tradi- 
tional type  of  educational  measurement.  Really,  however,  this 
has  not  been  neglect  on  our  part,  for  standardized  tests  are  noth- 
ing but  improved  examinations.  Furthermore  we  have  been 
learning  new  technics  which  will  in  time  react  to  improve  the 
making  of  examinations.  The  purpose  of  this  article  is  to  show 
teachers  how  they  may  make  use  of  one  of  these  new  technics 
of  scientific  testing  not  only  to  improve  certain  kinds  of  examina- 
tions but  also  to  make  examinations  a  real  pleasure  instead  of  an 
onerous  task  to  both  teacher  and  pupils. 

Below  is  an  illustration  of  a  new  way  to  make  an  examina- 
tion. It  is  designed  to  test  a  pupil's  knowledge  of  certain  facts 
concerning  the  physical  features  of  the  United  States.  We  have 
purposely  written  it  hastily  in  order  that  it  might  illustrate  cer- 
tain crudities  of  construction.  Any  teacher  in  the  elementary 
school  could  do  as  well  and  most  teachers  could  do  better. 

The  examination  as  presented  here  assumes  that  the  state- 
ments whose  truth  and  falsity  are  to  be  determined  by  the  pupils 
have  been  mimeographed  so  that  a  copy  of  the  examination  can 
be  placed  in  the  hands  of  each  pupil.  The  sample  examination 
given  below  is  supposed  to  have  been  worked  through  by  a  pupil 
and  then  scored  by  a  pupil  or  by  the  teacher.     The  check,  cross 
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and  0  mean  respectively  that  the  pupil's  answer  (i.  e.  his  under- 
lining) is  correct,  incorrect  or  omitted.  Due  to  limitations  of 
space,  only  enough  of  the  examination  is  shown  below  to  illus- 
trate the  procedure. 

SAMPLE  EXAMINATION  ON  UNITED 
STATES 
Some  of  the  following  twenty  statements  are  true 
and  soiTie  are  false.  When  the  statement  is  true  draw 
a  line  under  True;  when  it  is  false  draw  a  line  under 
False.  Be  sure  to  make  a  mark  for  every  statement. 
If  you  do  not  know,  guess. 

1.  In  general  the  mountain  ranges 

run  east  and  west True     False     V 

2.  Most  of  the  rivers  flow  north     True     False     V 

3.  Mt.  Mitchell  is  the  highest  point 

east  of  the  Mississippi  River     True     False     X 

4.  Mt.  Washington  is  higher  than 

Mt.  Mitchell  True     False     X 

5.  The    Catskill    Mountains    are    in 

Maine    True     False     V 

6.  The    Cascade    Mountains    are 

nearer     the     Pacific     Ocean 

than  the  Rocky  Mountains . .     True     False     X 

7.  The     Rocky     Mountains     are 

nearer  the  Pacific  Ocean  than 

the  Appalachian  Mountains . .     True    False      V 

8.  The     Blue    Ridge    is     in    the 

Rocky   Mountains True     False     V 

9.  There    are    more    active    vol- 

canoes in  the  west  than  in  the 

east  True     False     V 

10.  "Old  Faithful"  is  the  name  of 

a  cyclone  which  sweeps  up- 
ward from  Texas  into  Okla- 
homa      True     False     X 

11.  The  "Grand  Canyon"  was  cut 

through  the  Cumberland 
Plateau  by  the  Susquehanna 
River True     False     V 

12.  Pike's    Peak   is   in   the    Rocky 

Mountains True     False     V 

13.  The    Mississippi    River    flows 

into  the  Great  Lakes True    False     V 
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14.  All  the   following  are  tributa- 

ries of  the  Mississippi  River: 

Arkansas,    Missouri,    Ohio...     True    False     V 

15.  The  Big  Sandy  is  the  biggest 

river  in  the  United  States . . .     True     False     X 

16.  The  Atlantic  Ocean  is  to  the 

east    and    the    Pacific    Ocean  , 

to  the  v^est True     False    O 

17.  Canada  is  to  the  south  and  the 

Gulf  of  Mexico  to  the  north.     True     False     V 

18.  The   Great   Lakes   are   five   in 

number True     False     V 

19.  It     is     easier     to     sink     while 

swimming  in  the  largest  lake 
east  than  in  the  largest  west 
of  the  Mississippi True    False     V 

20.  The     central     portion    of    the 

United  States  is  on  the  whole 
more  level  than  the  eastern 
or  western  portion True    False     V 

Number  of  correct  underlinings  =  14 

Number  of  incorrect  underlinings         =     5 
Number  of  omissions  =     1 

Pupil's  score  ==  (number  correct)  —  (number  wrong).   (A) 
Pupil's  score  =  \A — 5=9 

Let  us  consider  first  the  reason  for  expressing  a  pupil's  score 
as  the  number  correct  minus  the  number  wrong.  Imagine  a 
pupil  who  is  absolutely  innocent  of  any  knowledge  of  the  physical 
features  of  the  United  States.  Were  such  a  pupil  to  take  the 
above  test  and  were  he  to  mark  every  statement,  he  would  accord- 
ing to  the  theory  of  chance  mark  ten  statements  correctly  and 
ten  incorrectly.  The  chances  of  his  guessing  right  or  wrong 
are  fifty-fifty  or  one  to  one.  His  score  on  the  above  test  would 
be: 

Score  =  10  —  10  =  0. 

In  short  the  pupil's  knowledge  is  zero  and  the  method  of  com- 
puting his  schore  gives  him  zero.  Suppose  instead  that  he  knows 
ten  statements  and  guesses  at  the  other  ten.  Of  the  ten  guessed 
at  he  would,  according  to  chance,  get  five  correct  and  five  wrong. 
That  is,  even  though  his  real  knowledge  is  ten  he  will  show  fifteen 
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correct  (10  +  5)  and  five  incorrect.     The  method  of  computing 
his  score  brings  out  his  real  knowledge. 

Score  =  15  —  5  =  10. 
A  pupil  who  marks  every  statement  correctly  makes  a  perfect 
score,  viz: 

Score  =  20  —  0  =  20. 

Observe  that  no  account  is  taken  of  omissions.  Only  the 
corrects  and  incorrects  figure  in  the  pupil's  score.  When  the 
time  allowed  the  pupils  to  take  the  test  is  made  short  in  order  to 
test  each  pupil's  rate  of  work  there  will,  of  course,  be  many 
papers  showing  several  omissions  each.  In  all  such  cases  omis- 
sions should  be  ignored,  just  as  we  have  done  above,  in  comput- 
ing scores.  Even  when  the  time  allowed  for  the  test  is  ample 
for  each  pupil  to  mark  every  statement,  there  will  still  be  an 
occasional  instance  of  omission  due  to  carelessness,  or  a  misun- 
derstanding of  instructions  or  a  puritanic  conscience  against  in- 
creasing the  score  by  gamble  guess-work  even  when  the  instruc- 
tions urge  guessing.  When  the  time  is  ample  for  even  the 
slowest  pupils  and  when  all  are  instructed  to  mark  every  state- 
ment it  is  much  more  convenient  to  compute  a  pupil's  score 
according  to  the  following  formula: 

Score  =  (number  of  statements) — 2  (number  marked  in- 
correctly )  .     .     .     .     (B). 

To  derive  this  formula  from  the  formula  marked  (A)  above, 
note  that  since  there  are  no  omissions,  the  number  of  corrects  (C) 
plus  the  incorrects  (W)  equals  the  number  of  statements  (N). 
Hence  we  may  write  C==N — W.  Substituting  this  in  formula 
(A)  gives: 

Score  =  (N— W)— (W)=N— 2W. 

If  there  are  20  statements  in  the  test  and  if  five  are  marked 
incorrectly. 

Score  =  (20)  —  2  (5)  ==  10 
Formula  (A)  gives  the  same  results,  i.  e. : 

Score  =  15  —  5  =  10 
Both  formulae  give  identical  results  provided  there  are  no 
omissions.  Formula  (A)  is  basic  and  should  be  used  when 
there  are  omissions.  Formula  (B)  should  be  preferred  when 
there  are  no  omissions  or  when  they  are  present  only  in  negli- 
gible amount.     Formula   (B)   is  much  more  convenient.     The 
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first  number  is  always  the  same  and  since  the  second  number  is 
twice  the  total  statements  marked  incorrectly,  it  is  only  necessary 
to  score  and  total  the  errors. 

It  is  very  difficult  for  some  people  to  believe  that  such  a  test 
as  we  have  outlined  above  does  anything  more  than  give  the 
highest  score  to  the  luckiest  guesser.  They  look  with  an  eye 
of  suspicion  upon  this  thing  we  call  chance.  '  Being  in  a  position 
which  offered  excellent  opportunity,  namely  treasurer  of  a 
Sunday  school,  we  once  tossed  pennies  for  heads  or  tails  fifty 
thousand  times.  The  results  came  out  25,000  heads  and  24,999 
tails.  Had  there  not  been  a  miscount  somewhere  the  two  would 
doubtless  have  come  out  exactly  even.  We  had  occasion  to 
watch  two  summer-school  teachers  engage  in  that  soul-absorb- 
ing, nerve-racking  game  of  chance  called  matching  pennies. 
Each  began  the  summer  with  a  special  bag  of  one  hundred  pen- 
nies. They  matched  for  several  minutes  daily.  The  last  we 
heard  they  were  still  matching  pennies  and  chance  had  prevented 
either  from  getting  complete  possession  of  the  other's  one 
hundred  pennies.  Chance  is  fatally  exact  when  the  pennies  or 
the  statements  in  the  test  are  numerous.  The  opportunities  for 
injustice  in  scores  multiply  in  proportion  as  the  number  of  state- 
ments is  reduced.  Hence  there  should  be  as  many  statements  in 
the  test  as  practical  limitations  will  permit. 

The  possibility  of  unreliability  of  pupil  scores  is  one  which 
this  sort  of  examination  shares  with  all  other  sorts  of  tests  and 
examinations.  Last  summer  we  gave  a  test  of  this  kind  to  our 
class  in  educational  measurement.  As  luck  would  have  it  two 
visitors  were  present  and  were  persuaded  to  take  the  examina- 
tion along  with  the  rest.  There  were  forty  statements  in  the 
test.  The  score  of  one  visitor  was  zero  and  of  the  other  -  2  (when 
scores  are  negative  they  may  be  considered  zero.  It  is  probably 
the  accidents  of  chance  which  show  an  individual  to  know  less 
than  nothing,  though  a  genuine  negative  score  is  possible  where 
an  individual  has  been  taught  errors. )  The  highest  score  made 
by  regular  members  of  the  class  was  36,  the  lowest  score  was  -  4, 
and  the  next  to  the  lowest  score  was  6.  The  student  who  made  -  4 
admitted  that  he  was  not  sure  of  the  truth  or  falsity  of  a  single 
statement  and  that  unexpected  outside  demands  had  until  then 
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prevented  him  from  studying.  Even  though  he  was  not  given 
an  F  at  the  end  of  the  summer  session  and  even  though  the 
course  is  not  required,  he  appeared  at  the  college  this  last  Septem- 
ber and  registered  for  the  course  again.  The  student  who  made 
a  score  of  6  registered  late.  He  had  been  in  the  course  only  four 
or  five  days.  The  individual  who  made  the  highest  score  was 
George  Melcher,  Director  of  the  Bureau  of  Research,  Kansas 
City,  Mo.  All  were  in  agreement  that  he  knew  more  about 
educational  measurement  than  anyone  else  in  the  class. 

During  a  semester  course  in  educational  psychology  we  gave 
four  examinations.  The  first  was  of  the  True-False  variety, 
the  second  was  of  the  traditional  What  and  Discuss  kind,  the 
third  was  True-False,  and  the  fourth  was  traditional  like  the 
second.  Each  test  lasted  about  thirty  minutes.  The  half-dozen 
best  and  poorest  students  according  to  the  first  test  remained 
with  negligible  variation  the  half-dozen  best  and  poorest  in  all  the 
examinations  no  matter  what  the  type.  An  amusing  and  pathetic 
incident  of  the  course  was  the  challenge  of  the  poorest  students  to 
the  rest  of  the  class.  Those  who  had  been  lowest  all  through 
the  term  proposed  in  the  last  test  to  displace  some  of  those  who 
had  been  consistently  above  them.  There  was  a  sudden  rise  in 
the  quality  of  everyone's  work,  but  the  lowest  remained  the  low- 
est. These  words  should  not  be  interpreted  as  meaning  that  the 
True-False  test  is  unusually  reliable.  So  far  as  our  inadequate 
data  go,  there  is  no  reason  to  suppose  that  it  is  much  more  reliable 
than  the  traditional  examination. 

There  are  a  few  suggestions  which  will  help  teachers  who 
may  wish  to  use  the  True-False  test.  First,  the  teacher  should 
so  construct  the  test  that  it  will  contain  approximately  the  same 
number  of  true  and  false  statements.  A  clever  pupil  may  get  a 
higher  score  than  he  deserves  if  he  discovers  there  are  many  more 
true  statements  than  false  statements  in  the  test  or  vice  versa. 
Suppose  there  are  many  more  true  statements  than  false  state- 
ments and  suppose  some  pupil  discovers  this  by  observing  the 
statements  that  he  knows,  or  by  observing  the  teacher's  bias  for 
writing  true  statements  instead  of  false  ones.  Naturally  when 
he  does  not  know  what  to  mark  he  will  mark  True  thereby  secur- 
ing a  little  larger  score  than  his  ability  justifies.     It  is  probably 
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by  just  such  utilization  of  the  errors  of  others  that  the  intelHgent 
get  through  Hfe  so  much  more  smoothly  than  the  stupid.  On  thf 
other  hand,  the  teacher  should  not  have  exactly  the  same  numbei 
of  true  and  false  statements  each  time,  because  this  will  invite 
clever  pupils  to  count  back  to  see  how  many  more  true  statements 
have  been  marked  than  false  statements.  Sometimes  there 
should  be  more  true  statements,  sometimes  more  false  statements, 
sometimes  the  same  number  of  each.  A  regular  plan  either  as 
to  content  or  arrangement  should  be  carefully  avoided.  All  the 
true  statements  should  not  come  first,  neither  should  the  true  and 
false  statements  be  alternated  as  a  regular  plan.  Let  chance 
determine  how  many  shall  be  true  and  how  many  shall  be  false 
and  in  what  order  the  true  and  the  false  shall  come. 

Second,  the  teacher  should  be  careful  to  keep  out  of  the  test 
all  ambiguous  statements.  Statement  number  18  in  our  sample 
test  is  somewhat  ambiguous.  It  says:  "The  great  lakes  are  five 
in  number."  Since  great  lakes  is  not  capitalized  a  pupil  might 
very  legitimately  interpret  this  to  include  Great  Salt  Lake 
and  others.  It  will  later  be  difficult  to  satisfy  this  pupil  that  his 
score  should  suffer  because  of  the  construction  he  gave  this  sen- 
tence. If  the  teacher  will  study  her  mistakes  in  this  respect  she 
will  soon  learn  how  to  reduce  such  ambiguities.  As  any  teacher 
can  testify,  the  danger  of  ambiguities  of  wording  are  not  peculiar 
to  this  test.  This  type  of  test  does  not,  however,  give  a  pupil  an 
opportunity  to  reveal  just  what  interpretation  he  places  upon  each 
statement.  If  the  teacher  follows  the  procedure  of  having 
pupils  score  their  own  or  each  other's  paper  all  cases  of  serious 
ambiguity  will  be  discovered.  Statements  which  are  particularly 
fliagrant  in  this  respect  can  be  omitted  in  scoring. 

Third,  the  teacher  should  inspect  not  only  this  but  any  sort  of 
test  from  the  point  of  view  of  just  what  the  test  measures.  State- 
ment 19  in  our  sample  test  illustrates  our  point.  Our  purpose  is 
to  test  whether  the  pupil  knows  that  the  largest  lake  west  of  the 
Mississippi  River  contains  more  salt  than  the  largest  lake  east  of 
the  Mississippi.  Instead  of  measuring  this  we  may  be  testing 
whether  a  pupil  knows  that  it  is  easier  to  sink  in  fresh  water  thar 
in  salt  water.     Complex  wording,  unfamiliar  terms,  the  use  of 
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negatives,  all  tend  to  make  the  test  a  linguistic  one.     Simple, 
brief  statements  without  negatives  are  best. 

Fourth,  the  teacher  may  so  construct  the  examination  as  to 
force  pupils  to  guess  wrong  due  to  the  power  of  suggestion.  This 
probably  explains  why  statement  15  was  marked  wrongly.  The 
pupil  doubtless  argued  to  himself  that  since  the  river  is  named 
the  Big  Sandy  it  probably  is  the  biggest  river  in  the  United  States. 
The  influence  of  having  many  suggestive  statements  in  the  test 
is  to  make  the  examination  more  difificult.  It  operates  to  give  to 
the  pupil  who  knows  nothing  at  all  in  the  test  a  large  negative 
score  instead  of  a  zero  score  and  it  penalizes  rather  heavily  the 
pupil  who  does  much  guessing,  for  every  time  he  allows  himself 
to  be  suggested  in  the  wrong  direction  a  point  is  substracted  from 
the  score  he  has  already  made  by  what  knowledge  he  has.  In 
other  words,  the  suggestive  statements  make  the  gap  between 
those  who  know  much  and  those  who  know  little  wider  than  it 
otherwise  would  be.  Whether  a  pupil  should  be  specially  penal- 
ized for  allowing  himself  to  be  maneuvered  wrong  is  an  arguable 
question.  There  may  be  situations  where  it  is  eminently  desir- 
able to  determine  whether  pupils  know  what  they  know  so  well 
as  to  be  able  to  resist  suggestion.  But  we  believe  that,  in  general, 
it  is  best  to  avoid  suggestive  statements.  The  ideal  should  be  so 
to  construct  the  examination  that  any  pupil  who  knows  absolutely 
nothing  about  the  test  will  make  a  score  of  zero. 
V  So  much  for  the  construction  of  the  examination.  How  shall 
it  be  applied  ?  The  best  way,  as  shown  by  our  sample,  is  to  print, 
mimeograph,  or  otherwise  duplicate,  the  examination,  and  place 
a  copy  in  the  hands  of  each  pupil.  But  there  are  numerous 
schools  which  lack  duplicating  machines.  For  teachers  in  these 
schools  some  other  means  for  applying  the  test  must  be  found. 
Any  one  of  the  following  methods  may  be  used.  First,  the  entire 
test  may  be  copied  word  for  word  by  the  pupils  and  then  marked. 
This  is  tedious  and  time  consuming.  Second,  the  entire  test  may 
be  written  on  the  blackboard  by  the  teacher.  Each  pupil  could 
number  a  blank  page  of  paper  to  correspond  to  the  numbered 
statements,  and  then  write  True  or  False  after  the  appropriate 
numbers.  The  only  objection  to  this  suggestion  is  the  incon- 
venience of  writing  all  the  statements  on  the  blackboard.     Third, 
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the  pupils  may  be  asked  to  copy  on  blank  paper,  1,  2,  3  and  so  on, 
according  to  the  number  of  statements.  The  teacher  can  then 
read  orally  statement  number  1  and  instruct  the  pupils  to  make  a 
check  after  the  number  1  on  their  paper  if  the  statement  is  true, 
but  to  make  a  cross  if  the  statement  is  false.  This  is  easily  the 
most  convenient  way  to  give  the  examination.  The  chief  objec- 
tion to  this  last  method  is  the  difficulty  some  pupils  have  in  appre- 
hending statements  presented  orally,  particularly  if  they  are  long 
and  complicated.  When  the  statement  is  presented  visually  the 
pupil  has  an  opportunity  to  go  back  to  it  enough  times  to  realize 
his  possibility  of  understanding  it.  By  one  or  another  of  these 
methods  it  is  possible  for  any  teacher  anywhere  to  make  use  of 
this  type  of  examination. 

How  should  the  True-False  examination  be  scored?  If  a 
copy  of  the  test  has  been  placed  in  the  hands  of  each  pupil,  the 
teacher  can  take  an  unused  test  sheet,  fill  it  out  correctly,  lay  the 
correct  column  of  answers  beside  the  pupil's  column  of  answers, 
and  quickly  mark  whether  the  pupil's  answers  are  correct  or  in- 
correct. If  a  copy  of  the  test  has  not  been  placed  in  the  hands  of 
each  pupil,  but  each  has  instead  written  True  or  False,  or  made  a 
check  or  cross  after  the  number  of  each  statement,  the  teacher  can 
take  a  page  of  paper  similar  to  that  on  which  each  pupil  has  indi- 
cated his  answers,  copy  the  numbers  just  as  they  are  and  just  as 
they  are  spaced  on  each  pupil's  paper,  write  after  each  number 
the  correct  answer  to  the  statement  of  that  number,  place  this 
column  of  correct  answers  beside  the  column  of  pupil  answers 
and  mark  those  which  are  correct  and  incorrect.  This  last  scor- 
ing method  presupposes  that  pupils  have  used  ruled  paper,  and 
that  each  has  written  his  numbers  in  a  vertical  column  according 
to  a  particular  spacing  recommended  by  the  teacher.  Last  and 
best  each  pupil  can  score  his  own  or  his  neighbor's  paper.  It  is 
better  for  him  to  score  his  own. 

If  the  method  of  pupil  scoring  is  adopted,  the  teacher  should 
read  the  correct  answers  while  the  pupil  checks  his  own.  If  the 
pupil  does  not  have  a  copy  of  the  statements  before  him,  the 
teacher  should  read  each  statement  before  giving  the  correct 
answer,  in  order  that  the  pupil  may  know  what  statements  he 
got  correct  or  incorrect.     When  all  the  pupils'  answers  have  been 
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marked  and  when  all  their  scores  have  been  computed  and 
recorded  on  their  examination  paper,  the  teacher  should  ask  all 
pupils  who  missed  statement  number  1  to  hold  up  their  hands, 
and  then  all  pupils  who  missed  number  2  to  hold  up  their  hands 
and  so  on.  The  teacher  should  make  a  record  of  the  number  of 
pupils  missing  each  statement,  and  then  collect  all  papers. 

But  why  should  this  sort  of  examination  be  given  at  all? 
Wherein  is  it  superior  to  the  examination  method  in  common 
use?  In  the  first  place,  the  True-False  examination  permits  a 
teacher  to  cover  a  wider  field  of  subject  matter  or  a  wider  range 
of  ability  per  unit  of  time.  It  may  be  made  more  representative 
of  the  total  field  of  the  pupils'  study.  In  the  case  of  the  tradi- 
tional examination  the  teacher  is  forced  to  select  a  very  small 
number  of  questions.  When  we  were  students,  almost  as  much 
of  our  ingenuity  went  into  divining  the  kind  of  questions  the 
teacher  would  ask  as  into  reviewing.  Now  that  we  are  teachers 
we  have  no  reason  to  suppose  that  this  practice  has  ceased. 
Rivalry  among  pupils  in  taking  the  traditional  examination  is 
largely  a  contest  in  guessing.  The  True-False  examination  can 
ask  so  many  questions  in  a  brief  time  that  the  only  hope  of  the 
pupil  is  to  study  everything  everyday  and  review  everything  when 
he  reviews.  Further,  this  extensive  examining  is  fairer  to  pupils. 
The  pupil  has  some  basis  for  the  time-honored  excuse  that  he  was 
so  unlucky  as  to  know  everything  except  the  particular  questions 
asked  by  the  teacher.  The  new  type  of  examination  rules  this 
alibi  out  of  court. 

The  use  of  this  type  of  examination  is  likely  to  improve  the 
relation  between  teacher  and  pupils.  The  traditional  examina- 
tion endangers  a  pleasant  relationship  because  pupils  more  or 
less  justly  suspect  that  the  score  they  make  depends  almost  as 
much  upon  their  conduct  as  upon  their  product.  According  to 
the  pupils'  suspicions  the  teacher  uses  her  control  over  scores  to 
vent  a  personal  spite  against  the  bad  boy,  and  to  express  her 
appreciation  of  the  "pet." 

There  is  no  question  but  what  the  pupils  are  partly  correct. 
The  traditional  examination  is  so  subjective  that  it  is  well-nigh 
impossible  for  the  teacher  to  prevent  her  judgment  from  being 
influenced  by  fluctuations  in  her  disposition  or  from  being  colored 
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by  her  affection  for  the  pupil  whose  paper  she  is  scoring.  The 
new  examination  does  away  with  these  prohfic  sources  of  un- 
pleasantness. It  is  so  objective  that  the  pupil  can  see  for  him- 
self just  how  well  he  did.  It  permits  self-scoring,  and  it  con- 
vinces a  pupil  that  the  score  he  gets  is  the  score  he  deserves. 

The  True-False  examination  is  more  enjoyable  for  the  pupils. 
"Children  cry  for  it"  may  be  a  bit  exaggerated,  but  at  any  rate 
they  hate  it  less.  It  offers  an  opportunity  for  a  contest  where 
the  rules  are  fair,  a  chance  for  a  larger  degree  of  participation  in 
the  examination.  It  is  agonizing  for  a  pupil  to  describe  at  great 
length  a  knowledge  which  he  does  not  possess  in  the  hope  that  his 
command  of  English  will  camouflage  his  lack  of  information. 
Here  is  a  question  which  was  asked  in  a  recent  examination  in 
educational  measurement: 

Which  three  of  the  tests  described  by  Whipple  do  you  think  would 
be  of  most  service  in  an  elementary  school,  if  your  school  had  a  psy- 
chologist to  apply  them  ? 

Consider  the  perspiration  it  must  have  cost  a  student  to  per- 
petrate this  answer: 

The  tests  described  by  Whipple  embraced  most  of  the  difficulties 
that  would  be  embraced  in  problems  of  classroom  instruction.  I  think 
his  tests  embrace  a  great  variety  of  methods  of  approach  and  it  seems 
difficult  for  me  to  think  of  just  three  to  whom  the  presence  of  a  psycholo- 
gist in  a  school  would  give  help.  I  would  think  it  would  be  the  tests  in 
which  knowledge  of  the  workings  of  a  child's  mind  and  its  growth  and 
development  would  be  most  apparent  since  those  not  particularly  trained 
might  focus  on  others  not  of  this  kind.  I  fear  it  would  be  unwise  to 
specifically  mention  just  three  when  the  number  is  so  great  which  would 
fulfill  all  these  requirements.  Every  teacher  to  be  a  psychologist  would 
help  all  classroom  measurement  work  of  whatever  kind  greatly,  I  know 
since  we  cannot  know  of  the  influence  of  a  test  upon  any  group  except 
by  the  mental  reaction  produced. 

The  True-False  examination  is  also  more  enjoyable  for  the 
teacher  because  the  scoring  is  easy,  rapid  and  automatic  when 
she  does  the  scoring,  and  far  more  rapid  when  the  pupils  do  the 
scoring.  The  pupils  cannot  well  assist  in  scoring  the  traditional 
examination,  and  for  the  teacher  to  score  forty  verbose  examina- 
tion papers  is  time-consuming  drudgery.  Every  moment  of  the 
time  while  scoring,  the  teacher  must  be  profoundly  concentrating 
upon  what  she  is  reading,  for  much  of  the  time  she  must  be  sepa- 
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rating  the  chaff  from  the  wheat  where  the  chaff  is  cleverly  painted 
to  look  like  wheat.  And  along  with  this  is  a  continual  emotional 
strain  caused  by  her  resistance  to  the  temptation  to  underscore 
some  and  overscore  others. 

The  True-False  examination  is  more  educative  to  the  pupils. 
The  proposition  that  pupil  scoring  will  relieve  the  teacher  of  much 
obnoxious  drudgery,  does  not  justify  the  inference  frequently 
made  that  what  is  non-educative  drudgery  for  the  teacher  will 
also  be  noneducative  drudgery  for  the  pupils.  On  the  contrary 
we  are  of  the  opinion  that  the  most  favorable  teaching  opportu- 
nity that  ever  comes  to  a  teacher  is  the  period  immediately  follow- 
ing an  examination.  The  pupil's  interest  to  know  what  parts  of 
the  examination  he  missed  and  what  he  got  correct  is  then  at 
white  heat.  Witness  the  interested  discussion  among  pupils 
immediately  following  an  examination.  It  is  inexcusable 
neglect  of  an  educational  opportunity  not  to  capitalize  these  pre- 
cious moments  for  correcting  erroneous  ideas,  clinching  right 
ideas,  and  filling  up  mental  spaces  where  ideas  are  not.  These 
values  can  best  be  realized  by  having  each  pupil  score  his  own 
paper  and  by  stopping  to  discuss  points  where  pupils  have  trouble. 
Of  course  not  every  correct  answer  indicates  knowledge,  but  the 
pupil  himself  usually  knows  when  he  knows.  This  examination 
is  also  more  educative,  because  it  is  likely  to  be  given  more  fre- 
quently. The  experience  of  Kirby,  Courtis,  and  others  with  prac- 
tice tests  shows  that  a  pupil  learns  more  during  testing  periods 
than  during  teaching  periods.  We  really  teach  when  we  test. 
This  examination  covering  as  it  can  a  wide  range  is  an  ideal 
method  of  review.  It  reveals  to  the  pupils  just  where  their 
difficulties  lie.     Testing  is  one  of  the  best  ways  of  teaching. 

The  True-False  examination  gives  the  teacher  a  fuller  knowl- 
edge of  conditions.  The  educative  value  of  testing  is  so  great 
that  testing  should  be  much  more  frequent  than  is  now  the  case. 
If  a  method  of  testing  is  available  which  involves  no  drudgery  to 
anyone,  testing  is  likely  to  become  more  frequent,  and  this  means 
more  complete  and  timely  information  about  the  abilities  and 
difficulties  of  the  various  pupils,  and  about  the  successes  and 
failures  of  teaching  efforts.  We  have  already  suggested  that 
the  teacher  keep  a  record  of  the  number  or  percent  of  pupils 
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missing  each  statement  in  the  examination.  This  record  will 
show  what  things  have  been  well-learned  or  poorly  learned,  and 
well  taught  or  poorly  taught.  Also  it  is  a  good  thing  for  a 
teacher  to  check  the  effectiveness  of  her  teaching.  This  can  be 
done  by  finding  the  average  of  all  pupils'  scores  and  bv  comparing 
this  average  with  the  total  number  of  statements  in  the  examina- 
tion or  at  least  the  total  number  of  facts  the  teacher  had  really  at- 
tempted to  teach  the  pupils.  If  the  average  score  is  20  out  of 
a  possible  40,  the  teaching  efficiency  is  50  percent. 

Finally  the  True-False  examination  is  a  genuine  honesty  test, 
and  shows  the  beginnings  of  a  technic  for  measuring  in  satis- 
factory fashion  this  valuable  character  trait.  Occasional  and 
unannounced  rescoring  of  each  pupil's  paper  by  his  neighbor  will 
catch  the  persistent  cheat.  It  is  better  that  he  be  discovered  in 
school  than  in  court.  His  discipline  can  usually  be  left  to  his 
fellow  pupils,  over  whom  he  was  attempting  to  gain  an  advantage 
dishonestly. 

We  have  listed  what  appear  to  be  the  chief  advantages  of  this 
type  of  examination  or  any  other  examination  which  is  similarly 
objective.  Most  of  these  claims  rest  upon  logical  probability  and 
a  limited  experience  and  not  upon  experimental  data.  This  last 
is  needed  and  will  follow  in  time. 

There  are  some  limitations  which  have  not  yet  been  discussed. 
It  is  claimed  first  that  this  examination  does  not  require  the  pupil 
to  demonstrate  a  power  to  organize  his  materials.  This  is  true 
in  the  sense  that  the  pupil  does  not  describe  in  zvriting  2l  compli- 
cated mental  organization  but  a  statement  can  be  so  worded  as  to 
require  an  exceedingly  complex  mental  organization  before  a 
correct  answer  can  be  unfailingly  given.  Consider  the  mental 
organization  that  must  precede  a  correct  answer  to  this  simple 
statement:  "If  the  trade  winds  blew  east  Peru  would  have  lux- 
uriant flora."  If  it  is  desired  to  test  a  pupil's  power  to  word  his 
thought  a  composition  test  may  be  given. 

Again,  it  is  claimed  that  this  examination  can  test  knowledge 
but  not  skill,  knowledge  but  not  the  ability  to  do.  Even  skills, 
however,  can  be  tested  by  this  type  of  examination.  To  reason 
that  trade  winds  blowing  east  would  be  warm,  would  absorb 
moisture  from  the  Pacific,  would  become  chilled  in  passing  over 
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the  Andes,  would  consequently  deposit  a  heavy  rainfall  for  Peru, 
which  taken  in  conjunction  with  the  equatorial  climate  would 
produce  a  luxuriant  flora,  is  one  sort  of  skill  which  this  examina- 
tion will  test.  Mathematical  skills  and  the  like  which  are  too 
complicated  to  describe  may  be  tested  in  at  least  two  ways.  An 
example  or  problem  may  be  stated  together  with  an  answer.  The 
pupil's  task  will  be  to  determine  by  working  the  problem  whether 
the  answer  given  is  true  or  false.  Or  instead,  the  teacher  may 
work  the  problem  on  the  blackboard  for  all  the  pupils  and  have 
them  indicate  whether  her  process  was  correct  or  incorrect. 

Finally  it  is  claimed  that  the  teacher  needs  to  know  why  a 
pupil  is  unable  to  answer  the  question  about  Peru  and  its  flora. 
The  True-False  examination  does  not  show  just  where  the  pupil's 
reasoning  process  went  wrong  or  stop-ped  altogether.  It  is  not 
diagnostic.  This  criticism  has  some  force.  An  examination 
should  be  as  diagnostic  as  possible.  If  a  teacher  wished  to  know 
where  the  pupil's  process  broke  down  she  could  give  a  subsequent 
more  detailed  examination  of  this  type.  The  statement:  "The 
trade  winds  are  warm  winds"  or  "Warm  winds  have  a  larger 
capacity  for  water  than  cool  winds,"  etc.,  would  reveal  whether 
the  pupils  were  acquainted  with  the  basic  principles,  facts  and  the 
like  necessary  to  reason  out  the  correct  answer  to:  "If  the  trade 
winds  blew  east  Peru  would  have  luxuriant  flora." 

The  traditional  examination  has  certain  advantages  which 
will  doubtless  continue  its  existence.  The  True-False  examina- 
tion is  a  herald  of  newer  and  better  types  of  examinations.  But 
even  now  we  have  in  the  True-False  examination  one  that  may 
be  used  by  any  teacher  anywhere  to  great  advantage. 


HURDLES,  A  SERIES  OF  CALIBRATED  OBJECTIVE 
TESTS  IN  FIRST  YEAR  ALGEBRA 
MURRAY  A.  DALMAN 
Director  Department  of  Reference  and  Research.  Indianapolis,  Indiana 
The  purpose  of  this  report  is  to  show  how  the  teachers  of 
algebra  in  one  high  school  solved  one  of  their  problems.     It  is 
because  the  material  is  in  daily  use  and  the  circumstances  com- 
mon that  the  discussion  may  be  of  value  to  teachers  searching  for 
help  in  one  of  their  amny  difficulties.    The  method  is  in  continu- 
ous use  in  the  Emmerich  Manual   Training  High   School   of 
Indianapolis,  Indiana — a  school  in  which  things  without  value 
are  eliminated. 

In  common  with  most  mathematics  teachers,  the  teachers  of 
first-year  algebra  in  that  school  were  concerned  with  the  great 
number  of  failures.  Because  they  were  excellent  teachers,  well- 
trained,  professionally  interested,  alive  to  every  problem  of  the 
department,  they  were  determined  to  effect  a  remedy  if  possible. 
They  tried  several  remedial  plans  which  either  did  not  succeed, 
or  were  given  up  on  account  of  administrative  difficulties. 

1.  Classes  were  made  up  on  the  basis  of  ability  in  algebra, 
and  pupils  were  redistributed  during  the  term  on  this  basis ;  but 
the  crowded  condition  of  the  school  made  this  division  difficult 
of  administration,  and  the  plan  was  itself  of  doubtful  value. 

2.  Classes  were  made  up  of  the  pupils  who  were  failing.  In 
some  of  these  sections,  special  emphasis  was  placed  upon  the 
extension  of  arithmetic  into  the  generalities  of  algebra.  In 
others  an  essential  minimum  of  algebra  was  taught ;  but  the  mini- 
mum varied  with  different  teachers,  and  the  results  were  widely 
different. 

3.  Student  assistants  from  the  upper  classes  were  appointed 
to  coach  the  dull  and  failing  and  made  a  brave  attempt  to  bring  up 
the  laggards,  but  the  results  were  about  the  same. 

4.  Supervised  study  classes  were  instituted  and  the  brighter 
pupils  did  better.  But  the  number  of  failures  was  nearly  as 
great  as  before,  and  the  doubled  cost  could  not  be  justified.  The 
administrative  difficulty  on  account  of  crowded  conditions  again 
interfered. 
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5.  A  series  of  mental  tests  was  given  and,  by  using  those 
tests  which  showed  a  sufficient  correlation  with  teachers'  ratings 
in  algebra,  it  was  found  possible  to  foretell  with  reasonable 
accuracy  a  pupil's  ability  and  probable  degree  of  success  in 
algebra.  A  set  of  "diagnosis  data"  was  worked  out  so  that  the 
mental  test  scores  could  easily  be  read  in  terms  of  algebra  grades. 
This  diagnosis  was  made  at  the  beginning  of  the  term  in  an  effort 
to  bring  each  pupil  to  function  to  the  limit  of  his  ability  in 
algebra,  or  to  find  a  reason  for  not  being  able  to  do  so.  This 
brought  considerable  improvement  in  the  condition ;  but  it  was  a 
rather  cumbersome  method  of  procedure.  The  results  of  the 
tests  were  good ;  but  the  testing  of  five  tc  seven  hundred  9B 
pupils,  the  scoring  of  papers,  and  the  diagnosis  of  each  case  was 
quite  a  task,  and  the  diagnosis  could  never  be  absolute.  There 
were  many  exceptions. 

These  attempts  to  bring  each  child  to  work  worthy  of  his 
ability  led  to  a  discussion  of  the  course  of  study  in  algebra  and 
the  requirements  for  passing.  The  needs  of  the  department 
were  brought  out  as  follows: 

1.  A  course  consisting  of  "minimum  essentials,"  with  a  uni- 

form requirement  for  passing. 

2.  More  difficult  work  and  courses  for  pupils  of  greater 

ability. 

3.  A  statement  of  requirements  for  the  pupils  and  teachers. 
In  revising  the  course  of  study  and  its  administration,  there 

were  four  facts  to  be  taken  into  consideration : 

1.  A  text  adopted  for  the  state. 

2.  The  standard  marking  system. 

3.  The  report  card  periods. 

4.  The    administrative    problems    and    difficulties    of    a 

crowded  school. 

The  "minimum  essentials"  course  was  intended  to  be  such  a 
course  that  all  pupils  who  completed  it  would  have  a  complete 
and  comprehensive  view  of  the  principles  of  first  year  algebra, 
although  they  would  be  unable  to  manipulate  quantities  skilfully 
enough  to  work  the  difficult  exercises. 

This  course  was  reached  by  an  analysis  of  the  ends  to  be 
attained  in  a  year  of  algebra.     It  was  a  matter  of  determining, 
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from  a  consideration  of  the  end  of  the  course,  what  knowledge 
of  principles  and  what  skills  in  manipulation  were  absolutely 
necessary  for  successful  or  barely  passing  work.  The  selection 
of  principles  was  a  comparatively  simple  matter,  but  the  second 
step  of  determining  the  skills  in  manipulation  required  was  not  so 
simple.  It  was  not  easy,  for  example,  to  be  sure  that  there  were 
no  especially  difficult  points  in  the  requirements — no  points,  that 
is,  under  any  topic  which  could  not  be  handled  by  pupils  who 
had  been  successful  in  the  previous  topics. 

Then  there  remained  the  difficulty  of  arranging  the  material 
so  that  both  pupils  and  teachers  would  know  definitely  what  the 
minimal  requirements  were.  To  solve  this  problem  and  also  to 
provide  successive  standards  for  pupils  of  successively  greater 
abilities,  a  series  of  objective  tests  was  planned. 

The  standard  marking  scheme  of  the  school  was  A4-,  excel- 
lent, 95  to  100  percent ;  A,  very  good,  90  to  95  percent ;  B,  good, 
80  to  90  percent ;  C,  fair  or  passing,  70  to  80  percent ;  and  D, 
failure,  below  70  percent.  Tests  were  accordingly  made  out  to 
fit  the  standards,  C,  B,  A,  and  A4-.  A  chart  was  made  (see 
Figure  1 )  for  posting  in  each  classroom  so  that  every  pupil  who 
passed  a  test  could  be  publicly  given  credit  for  it.  Successes 
were  indicated  by  heavy  dots  placed  in  certain  positions.  Such 
an  entry  in  column  R,  showed  that  the  work  to  date  had  been 
passed.  No  recognition  was  given  a  pupil  in  this  column  if  he 
had  failed  in  the  work  of  a  former  period  and  still  had  that  work 
to  make  up. 

In  the  succeeding  columns  were  entered  for  each  child  the 
grade  value  (C,  B,  A,  or  A+)  of  the  test  passed  and  the  number 
of  attempts  necessary  to  pass  it.  The  chart  provides  for  four 
attempts  under  each  test.  If  more  than  four  are  required  the 
number  of  attempts  may  be  entered  as  in  the  case  of  the  first 
pupil  designated  as  A.  S. 

The  chart  reads  as  follows:  I.  C.  made  a  grade  of  A,  or  90, 
passing  each  test  on  the  first  trial ;  L.  H.  made  a  grade  of  B,  but 
only  after  three  attempts  at  the  C  test  and  four  at  the  B;  etc. 
The  record  for  this  class  shows  that  2  were  failed,  7  received  a 
grade  of  C,  8  of  B,  5  of  A,  and  2  of  A4-. 

To  the  regular  form  of  chart  has  been  added  in  this  case, 
column  M,  for  the  diagnosis  of  algebraic  ability  made  at  the 
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FIGURE  I.       CLASS  RECORD  CHART,  SHOWING  PREVIOUS  DIAGNOSIS 
(m)  RECORDS  ON  FORMER  TOPICS  (r)  AND  TESTS  COM- 
PLETED (C,  B,  A,  A+).     ALGEBRA  II,  5tH  HOUR, 
ROOM    12,   M.  D.,  TEACHER 
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beginning  of  the  term  before.     Only  those  pupils  who  were  in 
attendance  at  that  time  have  records. 

The  only  instance  of  complete  disagreement  between  the 
diagnosis  and  the  grade  is  in  the  case  of  I.  C.  For  this  reason 
her  case  was  investigated.  It  was  found  that  her  parents  were 
deaf  and  dumb,  and  that  she  had  been  kept  closely  at  home.  She 
had  entered  school  late,  and  had  never  had  a  normal  mental 
growth.  She  failed  in  all  other  subjects  because  she  devoted  all 
her  time  to  her  algebra. 
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The  ninth  pupil  (B.  R.)  with  a  diagnosis  grade  of  98  reached 
a  grade  of  A-f  on  the  first  attempt  at  each  set  of  tests. 

Figure  2  is  a  comparative  arrangement  of  sample  tests  for 
each  topic  into  which  the  course  in  first  year  algebra  was  divided. 
The  tests  are  given  in  the  vertical  columns  in  the  order  in  which 
the  topics  are  taken  up,  and  in  the  horizontal  columns  in  the 
order  of  difficulty  in  the  tests  in  each  topic.  By  this  table  it  is 
possible  to  see  the  minimal  requirements  for  passing,  the  rela- 
tively greater  demands  for  a  B,  A,  or  AH-  grade  as  a  whole  or  to 
compare  the  relative  requirements  for  each  grade  in  any  topic. 

In  these  tests  the  passing  grade  is  100  percent  and  the  exer- 
cises are  calibrated  with  this  in  view.  This  avoids  questions  of 
credit  for  partial  solutions,  and  differences  of  judgment  on  the 
part  of  teachers,  and  also  makes  sure  that  each  pupil  who  passes 
a  test  is  familiar  with  all  the  principles  involved  and  can  accomp- 
lish the  manipualtions  necessary  for  success  in  the  next  topic. 

There  was  no  special  endeavor  to  make  all  the  exercises  of 
any  given  test  of  exactly  equivalent  difficulties  (although  this,  of 
course,  is  approximately  true),  but  rather  to  make  each  test  cover 
all  the  principles  and  conditions  underlying  the  particular  topic 
involved.  As  between  tests  of  the  same  grade  (C,  B,  A,  or  A+) 
the  effort  was  to  make  them  equivalent  to  each  other,  in  propor- 
tion to  the  increasing  knowledge  of  algebra. 

There  was  ho  attempt  to  make  the  test  for  pupils  of  greater 
ability  cover  all  the  points  and  principles  of  the  C  tests  although 
this  is  true  in  the  main,  but  rather  to  make  them  cover  the  addi- 
tional information  and  skill  in  manipulation  gained  by  the  pupils 
of  greater  ability. 

After  this  preliminary  work  had  been  completed,  the  result 
was  tried  out  in  two  classes.  This  trial  showed  that  the  analysis 
of  difficulty  in  making  the  tests  was  faulty  and  that  the  minimum 
set  was  higher  than  a  proportion  of  the  pupils  could  reach.  This 
was  due  to  the  fact  that  under  the  traditional  scheme  of  grading 
the  teachers  had  no  proper  conception  of  the  absolute  knowledge 
of  the  pupils,  and  that  the  imaginary  standards  were  never 
reached.  In  other  words  measuring  on  a  basis  of  the  accom- 
plishment of  approximately  three  fourths  or  70  percent  of  ma- 
terial of  a  wide  range  of  difficulty,  had  led  teachers  to  believe  that, 
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FIGURE  II.       THE  TESTS,  SHOWING  THE  REQUIREMENTS  FOR  PASS- 
ING AND  FOR  HIGHER  GRADES  IN  FIRST  YEAR  ALGEBRA 

CLASSIFIED  BY  TOPICS  AND  DIFFICULTY 


First  Semester — Algebra  I 
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Add: 
(1)               (2)               (3)               (4)               (5) 

-  2              -  6                   7                   3                   0 

-  7                   9             -11             -  3                   5 

6.  -2+7-4  = 

7.  -9+5  +  1- 

8.  7-4-3  = 

Add: 

(1)                 (2)                (3)                (4)                (S) 
-5                    5               _  2                 6                 -8 
4                -5               -7-3                 -7 
—3                   4               -10-7                     6 
-1                -3               +7             +8                 -1 

6.  -4-3+5-7  = 

7.  -6+5-7-2- 

8.  3-9+5-3- 

1 

Tfa  =  2,b=  -3,c  =  l,x=  -5,  y=0  and  z=6, 
find  value  of: 

1.  a+ab-c                        5.  x'     -  5a> 

2.  -2abx                               a2         a' 

3.  2h-                                     6     _    J.    _ 

4.  5ayb                                      3            4 

Grade  of  B  given  to  all  children  who  pass 
C  test  on  third  attempt. 

e 
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t 

Subtract: 

(1)         (2)             (3)             (4)             (5)             f6) 
—3      -9xy            8               0             — ac           2mn 
4      — 2xy         —7           — 7bc             ac          lOmn 

(7)                                  (8) 
a-3b+c                     2k          +3r 
3a-  b+5c                 -  k+Sm 

1.  Subtract    2x+x»-5-x«    from    l-3x»+2x-x« 

2.  From  ^a  +  fb-ctake  Sa-ib+Jc 

3.  From  2a  subtract  b+c 

4.  Subtract  x+2y  from  3x— z 

9  From  3x+2y— 4z  take  z+y  — 2x 
10  Subtract  3m— r+2p  from  m+r— 5p 

1.  The  perimeter  of  a  rectangle  is  160  yards. 
The  base  is  four  time  the  altitude.     Find   the 
dimensions  of  the  rectangle. 

2.  The    sum    of    two    numbers    is    78.     The 
greater  exceeds  the  less  by  4.     Find  the  numbers. 

3.  Solve     2x  — (3x+6)  =  ll— 2x     and     prove 
the  result. 

4.  Solve  S(x-2)+5  =20  and  prove  the  result. 

1.  A  farmer  wishes  to  enclose  a  rectangular 
field  for  a  pasture,  making  it  24  rods  wide.    He 
wants  to  make  it  as  long  as  possible,  using  168  rods 
of  wire  fencing  which  he  has  on  hand.    How  long 
can  he  make  it? 

2.  The  sum  of  two  consecutive  integers  is  69. 
Find  them. 

^.  The  sum  .if  the  ages  of  A  and  B  is  70  years. 
In  5  years  k  will  be  three  times  as  old  as  B.    Find 
their  ages. 

X      X 

4.  Solve =3.  Prove. 

2     5 

a 

1 

s 

Divide: 

1    x'-2x-lSbyx-5 

2.  6x2+5x+6  by  3x-2 

3.  a3+b3  by  a+b 

Divide: 

1.  6a+S-23a'+12a'by  4a-S 

2.  81m«-l  by3m+l 

! 

Find  prime  factors  of: 

1.  3xi+15x  +  18                5.  am+bm+ar+br 

2.  m«-a«                            6.  l-b> 

3.  3c»+6cy+3y«                7.  x»+x<+x» 

4.  6a>+22a+12                8.  b«+C« 

Find  prime  factors  of: 

1.  16k«-b*                         5.  2a»b»-2a5b'+2a»b 

2.  48a'+72a+27               6.  bx+by-mx-my 

3.  100x»-310x  +  150         7.  l-27m« 

4.  3x«-18x+24                8.  64x»+a» 
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First  Semester — Algebra  I 


A 

A+ 

1 

Add: 
(1)                (2)               (3)               (4)                 (5) 

-  3                 17            -14                12             -IS 
+  9              -12                 13             -10                 13 

-  8              -13                20                  7                 19 
+  12                  IS             -18             -  6             -12 
-IS             -20            -12            -17                10 

6.  19  +  16-20  +  12-10=- 

7.  20-8-12  +  16-S  = 

8.  19-7+8-4+3  = 

Add: 
(1)                  (2)                     (3)                       (4) 

17                    36                    -12                       32 

23                 -18                    -28                    -41 
-12                    45                       17                       13 

42                 -16                    -19                    -12 
-18                 -29                    +22                    -48 

30                

5.  -3S-12+19+1S-27- 

6.  lS  +  19-13+42-34  = 

1 

Grade  of  A  given  to  all  children  who  pass 
C  test  on  second  attempt. 

Grade  of  A+  given  to  all  children  who  pass 
C  test  on  first  attempt. 

t 
1 

1.  From  2aJb+3a'-ab»+b'  take    5a«+2ab»-2b» 

+4a2!) 

2.  Subtract  3x»+2x»y— y»  from  Sx»  — 2xy'+y» 

3.  By  how  much  does  2x— y  exceed  x+y? 

1.  From  the  sum  of  2a»-a«b+b»  and  3a»+2ab»— 

Sb'  take  the  sum  of  a'+3a»b-2b'  and  3a»  — 
ab»+4b' 

2.  By  how  much  does  3x— y+z  exceed  2x+y— m? 

3.  By  how  much  does  0  exceed  a+b? 

1 

1.  Find  the  integer  which  is  such  that  when 
increased  by  the  first  consecutive  integer  and  this 
sum  ''e-reased  by  the  second  consecutive  integer 
the  result  is  117. 

2.  .\  sum  of  money  amounting  to  $3.90  con- 
sists of  nickels  and  dimes.    There  are  41  coins  in 
all.     How  many  of  each  kind? 

3.  3(2x-4Hx+7)-2(3x-2)(x+5)  =  -3(x-2). 
Solve  and  check. 

1.  The  sum  of  two  consecutive  odd  integers 
is  72.    Find  them. 

2.  One-fourth   of  a  certain   number  exceeds 
one-sixth  of  it  by  S.    Find  the  number. 

3.  A  is  62  years  old  and  B  is  6  years  old. 
In  how  many  years  will  A  be  five  times  as  old  as  B. 

4.  Solve(x+10)(x-3)  =  (x-2)(x+6).  Prove. 

w 

Divide: 

1.  k«+k»m»+m«  by  k»+km+m» 

2.  5x»+lx-i  by  3x-l 

Divide: 

1.  15x»y»-16x«y+5xS+13x>-<-llx«y»-6y»   by   x> 
-3xy+2y« 

2 

Find  prime  factors  of: 

1.  9i<-S4x'+81               S.  ab-bx-ay+xy 

2.  m<a*-81k<                     6.  4x«+8x-96 

3.  a»bs-a«W+a»b«            7.  24a«+6ab-45b» 

1                        8.  64m»+rat» 

4.  64x« 

y' 

Find  prime  factors  of: 

1.  36a!+36ax-40x«          5.  8ac-12bc-6af+9bf 

2.  36a»+21ab-30b»         6.  36m'-48a«m+16a« 

3.  125k»+64r'b«                7.  81m«n<-16r* 

4.  lSm«a»-6m»n<+3m«n»                 1 

8.  8a» 

27x' 

1 
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Figure  2 — Continued 
Second  Semester — Algebra  II 


Find  prime  factors  of: 

1.  x«+5x+6 

2.  x«+6x+9 

3.  x'-j-xy+mx+my 

4.  3xi+5x+2 


5.  k«-25n» 

6.  8-a» 

7.  a3+64 

8.  c«-l 


(Results  must  be  expressed  in  lowest  terms) 
Simplify: 

X— 2a    2a— 2z    z— 3x 
1.   + H 


2ax 
1 


4az         3zx 
X        2x» 


x+4     1-x     x+2 

x+4  x+2 

(x+7)(x-2)     (x+4)(x+7) 

m'— a* 
m— a 

m+a 


Solve  and  check: 
2        3        1 

3m    5m    30 
8  12 

m— 5    m+4 
x+S    x+3    69 

4  5        100 


(5x+y=7  3.  Solve  by  Substitution. 

1.  Plot-I  (3x+y-30 

(x-2y  =  -3  (3y+x=34 

2.  Solve  by  Addition  or  Subtraction. 

<2x-10y  =  14 
I3x-Sy  =  l 


1.  Solve   by   completing   the   square   x'— 2x=4 

2.  Solve  by  factoring  method     n-— 7n"=18 

3.  Solve  x2 -49=0 


Find  prime  factors  of: 

1.  ax— ay— kx+ky 

2.  y<-10yS+9 

3.  9y«-6y«+v» 

4.  m»-a»+2ab-b« 


5.  27y«+a» 

6.  c'g'— 64c' 

7.  36>-«-36y« 

8.  36x«-6x-12 


(All  results  must  be  expressed  in  lowest  temu) 

Simplify: 

m  y 

+- 


4(m+y)    3(m-y> 
2a-b    2a+b       Sab 


2a +b    2a -b    4a>-b» 
1 

m«+m+l 

m-1 
1— a     1-a' 

1+a    l+a» 


Solve  and  check: 

Sx  3x       4x»-80 

2x+5    2x-5    4x»-2S 
x-2  3 

1-3  x-4 


Solve: 


I 
- 


y 

IS     18 


=  10 


(Results  must  be  true  to  three  decimal  places) 

1.  Solve  by  completing  the  square     25x'— 20x=3 

2.  Solve  by  factoring  method    2x'— 3x— 5=0 

3.  Solve    x»=S 
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Second  Semester — ^Algebra  II 


Find  prime  factors  of: 

I.  6x*--xy-2y«  5.  2Sa«y«-20a'c»y+4c« 

J.  6jt«-3ax+2mx-*in  6.  I6k<-1 

J.  l-64m«  7.  9x'+3ax-2a» 

4.  64k»+8m»  8.  x2-y«xi 


(All  result*  must  be  expressed  in  lowest  terms) 
Simplify: 

4x  Sx 

-h 


(S+x)(4-x)     (x+2)(x-A) 
b  a»  a«-b» 

a-b      as+ab+b«    a«-b» 
m»-2m+l 


3.    m«+m+l- 


m'— m+1 
2m  a— 2m 


(a-5m)«    (a-3m)(a— Sm)  a— 3m 


Solve  and  chrck: 

2i  +  l       2x-l  Sx+3 

1. 


3X-12     3X+15     x>+x-20 


Solve: 


6  2.  A   is   four-fifths   of 

[ — 0      B's    age;    but    in    four 

)x+3    3y+2  years,   A's   age   will    be 

five-sixths    of  B's    age. 

I    1  2  Find  their  present  ages. 

^^1+2     2y-f2'" 


1.  Find  two  consecutive  integers  whose  pro- 
duct is  240. 

2.  The  sum  of  a  number  and    ts  reciprocal 
6.5 

it  — .     Find  the  number 
28 


A+ 


Find  prime  factors  of: 
1.  25m«-9y»+12ay-4a« 
2    2x»-8x 

3.  2Sm«-f50m«a-|-25a» 

4.  6b«c«-2Sbc+14 


mx— mk4-2my 

— ax— 2ay-fak 
y<-f3y«-f4 
llx«-f-x-10 
27y«4-64m' 


(All  results  must  be  expressed  in  lowest  terms) 
Simplify: 

2-fa«  3a+l  Sa-1 

a«-9     (3-a){2-a)     (a-2)(a-l-3) 

a+b  a-b  2b» 

a'-fab+b>    a«-ab-l-b»^  a«+a»b»-(-b* 

m«-3m-|-9    m'-|-3m-f9 


m»-27 


m»-f27 


1.  A  has  $52  and  B  has  $68.  After  givinft  B 
a  certain  sum,  A  has  left  only  one-half  as  much 
money  as  B  then  has.     What  sum  did  A  give  to  B? 

2.  A's  age  15  one-third  of  B's  age,  and  6  years 
ago  it  was  one-fifth  of  B's  age.  Find  their  present 
ages. 


Solve  for  z  and  y: 
(bx-ay-b» 

'•ax— by —a* 


2.  The  sum  of  two  digits 
of  a  number  is  14;  and  if  18 
be  subtracted  from  the  num- 
ber, the  remainder  equals 
the  number  obtained  by 
reversing  the  digits.  Find 
the  number. 


1.  Find  the  bass  and  the  altitude  of  a  triangle 
whose  area  is  432  square  inches,  if  the  base  exceeds 
twee  the  altitude  by  12  inches. 

2.  Find  the  dimensions  of  a  rectangle  whose 
area  is  720  square  feet  if  the  sum  of  the  base  and 
altitude  is  54  feet. 
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pupils  who  were  barely  passing  had  learned  a  great  deal  more 
than  they  really  had,  if  measured  in  terms  of  absolute  and  not 
relative  knowledge.  Requirements  had  to  be  changed  and  tests 
rewritten  to  conform  to  classroom  conditions. 

After  many  trials,  reducing  the  difficulty  of  one  test  increas- 
ing that  of  another,  a  set  of  tests  was  perfected  as  far  as  the 
limitations  of  two  classes  and  two  teachers  would  allow.  The 
number  of  tests  for  each  topic  was  fourteen,  five  C,  four  B,  three 
A  and  two  A+  tests.  This  number  was  found  to  be  enough  to 
cover  all  but  the  most  exceptional  cases,  that  is,  no  pupil  who 
attempted  five  C  tests  and  failed,  was  likely  to  succeed  on  the 
sixth. 

The  next  endeavor  was  to  show  the  value  of  the  "Hurdle 
Scheme"  in  comparison  with  the  traditional  type  of  work.  This 
was  done  in  experimental  and  control  groups.  The  test  method 
easily  proved  its  merit  by  the  reduced  number  of  failures  and  the 
increased  knowledge  of  algebra.  Although  the  C  tests  seemed 
ridiculously  easy,  the  control  groups  could  not  pass  them,  show- 
ing that  the  knowledge  of  the  pupils  was  not  uniform  or  absolute 
but  rather  haphazard  or  hazy,  that  is  they  could  do  much  more 
difficult  work  in  which  some  principles  were  involved  but  could 
not  do  work  which  involved  all  of  the  principles  demanded  in  the 
"minimum  essentials"  course. 

The  value  in  the  use  of  "Hurdles"  is  also  shown  by  a  compari- 
son of  the  final  grades  for  groups  in  which  the  hurdles  were 
used  with  those  for  the  control  groups  in  which  they  were  not. 
Table  I  shows  the  distribution  of  grades  D,  C,  B,  A,  and  A+ 
among  63  pupils  remaining  to  the  end  of  the  term  in  three  sec- 
tions in  which  the  hurdles  were  used.  Table  U  shows  the  same 
facts  for  229  pupils  in  twelve  sections  in  which  the  hurdles  were 
not  used. 

Table  HI  shows  the  percent  of  pupils  receiving  each  grade  in 
regular  classes  and  in  classes  using  the  hurdles.  The  per- 
cent of  failures  is  much  greater  among  the  regular  classes  as  is 
also  the  percent  of  those  receiving  the  lowest  passing  mark.     A 
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TABLE    I.       PUPILS    IN     3     CLASSES     IN     ALGEBRA    II    IN     WHICH 

"hurdles"  WERE  USED,  CLASSIFIED  BY  GRADES  RECEIVED 

SCHOOL   REPORTS,    FIRST    SEMESTER,    1915 


Class 

Total 

Number  Receiving 

D 

C 

B 

A 

AH- 

I 

22 

1 

1 

12 

7 

1 

II 

22 

0 

7 

8 

5 

2 

m 

19 

3 

6 

7 

2 

1 

Total 

63 

4 

14 

27 

14 

4 

TABLE    11.       PUPILS    IN     12    CLASSES    IN    ALGEBRA    II    IN    WHICH 
"hurdles"  WERE  NOT  USED,  CLASSIFIED  BY  GRADES  RE- 
CEIVED  SCHOOL  REPORTS,  FIRST  SEMESTER^  1915 


Class 

Total 

Number  Receiving 

D 

C 

B 

A 

A+ 

I 

16 

1 

13 

2 

II     . 

16 

2 

8 

6 

Ill 

20 

3 

11 

6 

IV     . 

18 

1 

7 

10 

V 

23 

1 

14 

6 

2 

VI     .    . 

18 

1 

12 

5 

VII 

22 

4 

11 

4 

3 

VIII 

20 

3 

8 

5 

2 

2 

IX 

17 

4 

3 

7 

2 

1 

X     .... 

20 

4 

10 

6 

XI 

19 

4 

11 

4 

XII  .... 

20 

6 

6 

7 

1 

Total 

229 

34 

114 

68 

10 

3 

decidedly  greater  proportion  of  the  pupils  in  classes  using  the 
hurdles  received  the  higher  ratings. 
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TABLE    III.       PERCENT    OF     PUPILS     RECEIVING     EACH     GRADE     IN 
REGULAR  CLASSES  AND  IN  CLASSES  USING  "hURDLES" 


Grade 

Regular 
Classes 

Classes 

using 

Hurdles 

1 

2 

3 

D 

14.85 

49.78 

29.69 

4.37 

1.31 

6  35 

C 

B 

22.22 
42  86 

A 

22  22 

A+ 

6  35 

Total 

100.00 

100  00 

The  facts  of  Tables  II  and  III  have  been  graphically  com- 
bined in  Figure  3.  These  graphs  show  the  percent  distribu- 
tion by  grades  of  the  three  classes  using  the  hurdles  and  the 
twelve  not  using  them.  The  near  approach  of  Curve  II  to  the 
normal  and  the  skewing  of  Curve  I  to  the  right  shows  the  advan- 
tage of  the  use  of  hurdles. 
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FIGURE  3.       THE  DISTRIBUTION  OF  GRADES  IN  THREE  CLASSES  IN 

WHICH  "hurdles"  WERE  USED,   (cURVE  II )   AND  IN 

TWELVE  CLASSES  IN  WHICH  THE  "hURDLES" 

WERE  NOT  USED,   (cURVE  l). 
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TABLE    IV.       THE    PUPILS    IN    ELEVEN    CLASSES,    ALGEBRA    II,    IN 
WHICH  "hurdles"  were  USED,  CLASSIFIED  BY  GRADES 

RECEIVED SCHOOL  RECORDS — SECOND 

SEMESTER,   1916-1917 


Total 

Number  Receiving 

Class 

D 

C 

B 

A 

A+ 

I 

19 

3 

3 

6 

6 

1 

II 

20 

2 

7 

7 

4 

Ill 

25 

4 

4 

16 

1 

IV 

14 

2 

9 

1 

2 

V 

17 

2 

3 

3 

7 

2 

VI 

20 

2 

7 

4 

4 

3 

VII 

21 

3 

11 

'    6 

1 

VIII 

19 

6 

4 

8 

1 

IX 

15 

4 

1 

5 

4 

1 

X 

21 

4 

4 

9 

4 

XI 

15 

1 

2 

7 

4 

1 

Total 

206 

24 

40 

81 

49 

12 

Table  IV  shows  the  distribution  of  grades  in  eleven  classes 
in  which  the  hurdles  were  used  after  their  introduction  through- 
out the  department.  These  classes  and  the  twelve  used  in  Table 
II  were  chosen  because  they  were  taught  by  the  same  teachers. 
While  the  results  are  not  as  satisfactory  as  those  shown  in 
Table  I  they  are  much  better  than  those  in  Table  II. 
The  percentage  distribution  is  as  follows: 

D   11.65 

C   19.42 

B   39.32 

A  23.79 

A+    5.83 

Total   100.01 

Figure  4  shows  in  graphic  form  the  facts  of  Table  IV.  The 
divergance  from  normal  lies  in  the  fact  that  the  curve  is  bent 
downward  at  the  C  and  upward  at  the  D  line.    Some  of  the  pupils 
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who  should  have  had  C  were  evidently  not  reached  and  became 
D's. 
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FIGURE    4.       THE     PERCENT    DISTRIBUTION     BY     GRADES    OF     THE 

PUPILS  IN  ELEVEN   ALGEBRA  CLASSES  IN   WHICH 

THE  "hurdles"  WERE  USED 

Table  V  shows  for  16  classes  of  one  semester  the  number 
gaining  in  rank  or  losing  in  rank  in  the  successive  topics.  Under 
ideal  conditions,  with  an  ideal  set  of  tests,  the  pupil  who  could 
achieve  A+  in  the  first  topic  would  achieve  A+  in  all  topics  and 
the  pupil  who  was  barely  able  to  make  C  in  one  topic  should  be 
barely  able  to  make  C  in  all  the  others. 

The  tests  are  far  from  ideal  and  the  conditions  were  only 
normal  but  the  deviations  in  rank  as  pupils  passed  the  successive 
tests  were  not  many  as  evinced  by  the  table.  The  tests  on  addi- 
tion of  fractions  were  slightly  more  difficult  than  any  of  the 
others  because  seven  more  lost  than  gained  in  rank  and  the  tests 
on  fractional  equations  were  slightly  less  difficult  because  nine 
more  gained  than  lost.  Of  the  totals  eight  more  gained  than  lost 
but  this  number  is  so  small  that  as  in  the  case  of  the  gains  or 
losses  in  particular  topics,  the  irregularities  of  attendance,  and 
interruptions  would  always  cause  that  amount  of  deviation. 

The  discussion  of  methods  has  no  place,  theoretically,  in  any 
course  of  study,  but,  practically,  the  administration  of  a  course 
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or  the  method  of  conducting  the  work  is  an  integral  part  of  the 
course.  The  "Hurdle  System"  was  devised  so  as  to  interfere  as 
little  as  possible  with  the  usual  methods  of  the  recitation.  It  does, 
however,  emphasize  attention  to  individuals.  On  this  account, 
therefore,  a  brief  explanation  of  a  change  from  the  ordinary- 
method  may  be  desirable. 

TABLE  V.       NUMBER  OF  PUPILS  WHO  GAINED  OR  LOST  IN  RANK  IN 
CLASSES   OF    ALGEBRA   II 

Number  of  pupils  in  16  classes  remaining  to  end  of  term. . . .     380 

Number  making  same  grade  in  all  tests  of  series 240 

Number  making  gain  in  rank  or  loosing  in  rank  or  both 140 

Number  making  gain  in  rank 80 

In    factoring 18 

In  addition  to  fractions 18 

In   fractional  equations -26 

In  simultaneous   equations 18 

In  quadratic  equations 7 

Number   loosing  rank 72 

In    factoring 15 

In  addition  of  fractions 25 

In  fractional  equations 17 

In   simultaneous  equations 8 

In  quadratic  equations 7 

The  teacher  takes  up  any  new  topic  as  "Addition  of  Frac- 
tions" in  any  way  he  thinks  best.  As  soon,  however,  as  he 
thinks  that  one  third  or  more  of  the  class  have  a  sufficient  knowl- 
edge of  principles  and  skill  in  manipulation,  he  gives  a  C  test.  He 
then  has  two  groups  and  the  difficulties  of  each  child  in  the  lower 
group  are  shown  by  his  errors  on  the  test.  These  points  can  be 
emphasized  in  any  exercises  the  class  is  engaged  upon,  and  class 
work  goes  on  as  usual.  After  an  interval  another  C  test  and  a  B 
test  are  offered.  Then  there  are  three  groups  but  the  lowest 
group  is  very  small  and  it  is  possible  to  give  them  individual 
attention  and  supplementary  calibrated  lists  of  exercises  laying 
special  stress  upon  the  shortcomings  of  each  pupil.  The  regular 
work,  however,  is  continued,  for  the  slow  pupils  can  understand 
the  solution  of  difficult  exercises  although  they  may  not  be  skillful 
enough  to  manipulate  the  quantities  successfully.  On  the  one 
hand,  the  bright  pupils  are  intent  upon  getting  sufficient  know- 
ledge and  skill  to  enable  them  to  pass  the  higher  tests  which  they 
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know  will  be  offered  as  soon  as  they  are  ready  for  them.  On  the 
other  hand,  the  slow  pupils  while  they  are  doing  tasks  adapted  to 
their  skill  are,  at  the  same  time,  profiting  by  the  teaching  of  the 
more  capable  pupils.  For  the  latter  are  working  on  similar, 
though  more  difficult,  material.  In  other  words  their  exercises 
involve  the  same  principles  which  the  slower  children  are  also 
attempting  to  apply. 

Teachers  soon  develop  a  technic  of  handling  pupils  in 
groups,  and  since  these  groups  are  mechanically  sorted  out  for 
their  attention,  they  can  arrange  materials  and  methods  to  fit  the 
needs  of  each  group.  This  is  especially  easy  since  each  group 
has  advance  notice  or  a  sample  of  the  requirements  for  the  next 
test. 

The  chart  on  the  wall  keeps  up  the  enthusiasm  of  every  child 
and  cures  many  cases  of  laziness  because  of  the  spirit  of  competi- 
tion it  engenders.  The  lazy  pupil  cannot  hold  the  esteem  of  his 
fellows  by  an  occasional  show  of  brilliance  and  at  the  same  time 
depend  upon  it  to  get  him  a  good  mark  from  the  teacher  at  the 
end  of  the  term.     His  record  shows.    He  gets  what  he  earns. 


TiDYMAN,    WiLLARD    F.     The    teaching    of    spelling.     (School    monograph 
series.)     Yonkers-on-Hudson,    N.    Y. :     World    Book    Company,     1919. 
178  pp. 

The  literature  giving  accounts  of  educational  research  which  is  appear- 
ing in  increasing  volume  in  our  educational  periodicals  and  in  miscellaneous 
publications  is  making  the  demand  for  well-organized  summaries  a  pressing 
one.  An  attempt  to  meet  this  matter  has  been  made  in  the  case  of  spelling 
by  Dr.  W.  F.  Tidyman  in  his  recent  monograph  on  the  teaching  of  spelling. 
He  states  that  his  purpose  is  "to  bring  together  from  all  sources  the  more 
reliable  and  pertinent  facts  of  the  teaching  of  spelling  and  to  present  them  in 
their  relation  to  the  practical  problem  which  the  teacher  has  to  face  every 
day  in  the  classroom."  Aside  from  the  fact  that  teachers  and  superinten- 
dents generally  do  not  have  access  to  the  original  sources,  it  is  very  difficult 
task  to  translate  the  results  of  research  into  guiding  principles  and  rules  for 
schoolroom  practice.  Therefore,  the  writer  of  this  monograph  has  rendered 
distinctive  service  in  bringing  together  some  of  the  more  reliable  and  per- 
tinent facts  in  the  field  of  spelling. 

The  table  of  contents  is  a  good  index  of  the  topics  treated: 

CHAPTER 

I.  The  Selection  and  Classification  of  Words 

II.  Preliminary  Testing  for  Word  Difficulty 

III.  The  Psychological  Basis  of  Spelling 

IV.  The  Presentation  of  Words 

V.  Independent  Study  and  Reviews 

VI.  The  Prevention  and  Treatment  of  Errors 

VII.  Testing 

VIII.  The   Measurement  of   Spelling   Efficiency 

IX.  Factors  Affecting  Spelling  Efficiency 

APPENDIX 

A.  Spelling  Plans 

B.  Minimum  Word  List 

BIBLIOGKAPHY 

spelling  Material 

The  Psychology  of  Spelling 

The  Pedagogy  of  Spelling 

Scales  and  Standards  Tests 

Factors  Affecting  Spelling  Efficiency 

General  Studies — Summaries,  Discussions,  etc. 

One  of  the  most  valuable  features  of  the  book  is  the  bibliography.  In 
addition  to  being  classified  under  the  headings  given  above,  there  are  help- 
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ful    subdivisions.    For    example,    under    the    general    heading    of    spelling 
material,  the  scources  are  grouped  under  the  following  sub-topics : 

Word  lists,  difficult  words,  common  misspellings,  classes  of  errors,  grad- 
ing, grouping,  hon»onyms. 

Under  the  pedagogy  of  spelling  we  find  the  following  subdivisions : 
Syllabihcation  and  diacritical  marks,  meaning,  divisions,  method  of  pre- 
sentation, speihng  plans,  the  value  of  rules,  trans ter,  class  study  versus  inde- 
pendent study,  spelling  consciousness,  correction  or  errors. 

Such  a  grouping  of  references  for  particular  topics  will  be  very  help- 
ful to  anyone  who  wishes  to  consult  the  original  sources. 

A  net  total  of  114  sources  is  mentioned.  Only  a  very  limited  number 
of  unpublished  theses  are  included.  It  is  probably  too  much  to  expect  of  a 
writer  to  include  in  such  a  summary  such  sources  but  there  is  a  considerable 
accumulation  of  unpublished  reports  some  of  which  are  very  valuable.  For 
the  most  part,  they  have  not  been  listed  and  extensive  and  persistent  corres- 
pondence would  be  required  to  unearth  them.  In  comparison  with  some  other 
bibliographies  on  spelling,  it  appears  that  sources  in  the  general  field  of 
psychological  research  have  not  been  completely  canvassed.  This  shortcom- 
ing is,  however,  offset  by  the  inclusion  of  a  number  of  references  from 
foreign  publications. 

The  style  of  the  book  is  simple  and  teachers  will  find  it  readable.  Few 
direct  citations  to  sources  are  made  and  interwoven  with  the  summary  of  the 
results  of  research  is  much  of  the  writer's  pedagogical  theories  and  beliefs 
in  this  field.  Use  is  made  of  paragraph  side  headings  in  italics  as  well  as  fre- 
quent centered  headings.  This  makes  it  easy  to  locate  in  the  chapter  the 
discussion  of  even  minor  topics.  At  the  end  of  each  chapter  there  is  a  sum- 
mary consisting  of  numbered  statements  which  are  in  the  form  of  principles 
and  rules  for  the  teaching  of  spelling. 

Students  in  the  field  of  education  will  be  disappointed  that  the  writer 
has  not  given  specific  citations  to  the  sources  on  which  his  principles  and  rules 
are  based.  However,  this  omission  will  not  be  missed  by  the  general  reader. 
In  general,  the  writer  does  not  discuss  in  a  critical  way  the  accounts  of 
research  which  he  uses.  However,  a  critical  comparison  of  analyses  would 
not  be  in  keeping  with  his  announced  purpose.  The  book  will  meet  a  real 
need  and  Dr.  Tidyman  is  to  be  commended  upon  his  effort. 

W.  S.  M. 

Lyon,  Leverett  S.  A  survey  of  commercial  education  in  the  public  high 
schools  of  the  United  States.  (Supplementary  Educational  Monographs, 
V.  3,  no.  5,  1919.)     Chicago:    University  of  Chicago  Press.    62  pp. 

Commercial  education  in  high  schools  has  been  slow  to  accept  scientific 
procedure  in  its  reorganization.  Developing  as  it  did  immediately  out  of  the 
practices  of  business  colleges,  commercial  education  has  been  more  or  less 
formal  and  routine  in  character.  One  of  the  first  steps  in  a  progressive  modi- 
fication of  traditional  practices  is  a  thorough-going  study  of  existing  practices, 
together  with  a  careful  analysis  and  evaluation  of  these  practices  in  the  light 
of  modern  social  needs. 
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Mr.  Lyon's  monograph  reports  the  results  of  a  careful  investigation  of  the 
practices  in  the  commercial  departments  of  one  hundred  thirty-six  high  schools 
in  different  sections  of  the  country.  Among  the  problems  which  were  studied 
are  the  following:  the  percentage  of  students  in  commercial  courses,  the 
length  of  commercial  courses,  the  kinds  of  subjects  included  in  these  courses, 
and  the  English  requirements.  Special  consideration  is  given  to  the  "social- 
business"  subjects.  The  fact  is  em.pliasized  that  there  is  genuine  need  for 
agencies  through  which  much-needed  text  and  reference  material  can  be 
organized  and  published.  In  a  final  chapter  entitled  "Plans  and  Policies  in 
Secondary  Commercial  Work,"  Mr.  Lyon  points  out  the  need  for  a  study  of 
the  purposes  of  high  school  commercial  courses  in  "modern  functionalized 
society."  In  addition,  he  shows  the  need  of  scientific  surveys  and  investiga- 
tions to  secure  the  facts  on  which  to  base  radical  changes  in  current  practices. 

Although  Mr.  Lyon's  stuy  is  by  no  means  exhaustive,  it  represents  the 
most  comprehensive  and  scientific  investigation  of  its  kind  which  has  been 
made  in  the  field  of  commercial  education.  It  should  be  lead  by  superinten- 
dents, high  school  principals,  and  all  teachers  of  commercial  education. 

W.  S.  G. 

HoBSON,  Elsie  Garland.    Educational  legislation  and  administration  in  the 
state  of  New  York  from  1777  to  1850.     (Supplementary  educational  mono- 
graphs, V.  3,  no.  I,  igi8.)     Chicago:  University  of  Chicago  Press.     267  pp. 
In  this  monograph.  Miss  Hobson  has  analyzed  and  summarized  the  educa- 
tional legislation  of  the  state  of  New  York  from  1777  to  1850  in  terms  that  are 
intelligible  to  the  average  reader.     The  following  topics  receive  considerable 
emphasis   in   her  discussions :     formative   influences ;    dual   system   of   school 
control ;  education  under  regents ;  the  common  school  system ;  special  legisla- 
tion for  cities;  support  of  education;  and  education  of  special  classes.     The 
appendix  contains  complete  lists  of  titles  of  the  legislative  acts  with  exact  refer- 
ences to  the  sources  where  each  may  be  found ;  abstracts  of  the  charters  of 
colleges,  academies,  and  other  types  of  institutions ;    abstracts  of  legislation 
concerning  school  lands  and  funds ;   common   school  acts  and  other  similar 
data. 

Miss  Hobson  has  investigated  a  field  in  which  much  research  work  is 
necessary.  It  is  obvious  that  an  exact  knowledge  of  educational  legislation 
during  the  early  periods  of  our  history  is  necessary,  if  we  are  to  understand 
the  evolution  of  the  various  public  school  systems.  It  is  also  evident  that  this 
type  of  educational  history  will  supply  facts  for  interpreting  and  modifying 
present  school  practice.  Furthermore,  it  will  aid  greatly  in  throwing  light  on 
our  social,  religious,  economic  and  political  history.  From  various  points  of 
view,  therefore,  this  monograph  is  a  valuable  contribution  to  the  history  of 
American  education. 

W.  S.  G. 
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SCIENTIFIC   SUPERVISION 

Supervision  is  a  term  whose  meanings  range  from  the  general 
oversight  which  a  superintendent  gives  to  the  school  system  as 
a  whole  to  the  aid  given  by  one  teacher  to  another.  However, 
supervision  of  instruction  is  a  well  defined  and  important  phase 
of  educational  activity  in  American  schools,  and  as  such  is  a 
proper  field  for  measurement  and  research.  Moreover,  it  has 
come  about  in  the  chaotic  and  uncontrolled  evolution  of  our 
school  system,  that  in  the  past  little  attention  has  been  directed  to 
the  nature  and  laws  of  supervision  so  that  the  opportunities  for 
constructive  efforts  in  this  field  are  very  great. 

This  Journal  will  welcome  accounts  of  the  application  of 
scientfic  methods  to  supervisory  problems.  School  men  every- 
where are  beginning  to  consider  the  best  ways  of  organizing 
supervision  of  instruction  is  a  well-defined  and  important  phase 
They  are  analyzing  the  work  of  supervision  and  finding  that  it 
consists  of  many  different  types  of  activity.  The  inspection  and 
rating  of  teachers  is  a  well-recognized  function  of  supervisory 
work  and  one  which  eventually  entails  measurement.  Instruc- 
tion and  assistance  are  two  other  functions  in  which  measure- 
ment may  be  of  very  great  aid,  both  in  selecting  the  teachers  in 
need  of  training  and  in  evaluating  the  effect  of  the  training  given. 
Then  there  are  the  larger  problems  of  curriculum  building,  the 
setting  of  standards,  the  determination  of  the  efficiency  of 
various  methods.  Finally,  there  is  the  problem  of  determining 
the  effect  of  supervision  itself  and  of  the  condition  under  which 
it  produces  its  optimum  results. 

Scientific  methods  are  already  rapidly  transforming  supervi- 
sion and  will  greatly  increase  its  effectiveness.  Any  school  sys- 
tem doing  constructive  work  in  this  field  should  feel  it  a  duty  to 
publish  an  account  of  its  experiments  for  the  stimulation  and 
guidance  of  other  workers.  Contributions  of  this  character  are 
solicited.     From  time  to  time,  also,  articles  dealing  with  the 
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general  principles  and  theory  of  supervision  will  appear  in  these 
pages,  and  every  effort  will  be  made  to  make  the  Journal  of 
service  to  those  whose  interests  center  in  supervisory  activities. 

S.  A.  C 

EDUCATIONAL  TESTS  AS  IMPORTANT  SCHOOLROOM 
EQUIPMENT 

During  the  decade  which  is  just  closing  much  emphasis  has 
been  given  to  demonstrating  to  schoolmen  that  the  results  of 
teaching  can  be  measured  by  scientifically  devised  instruments. 
Within  this  period  a  large  number  of  educational  tests  have  been 
devised  and  several  of  them  have  been  and  are  now  being  ex- 
tensively used.  It  appears  that  there  is  no  longer  any  need  to 
demonstrate  the  possibility  of  measurement.  It  is  accepted  for 
certain  school  subjects  by  even  the  conservatives.  The  need 
today  is  rather  for  educating  superintendents,  principals,  and 
teachers  in  the  effective  use  of  educational  tests.  This  need  is 
particularly  urgent  in  the  case  of  teachers  for  two  reasons. 
First,  there  are  many  more  teachers  than  superintendents  and 
principals  and  in  general  they  have  not  had  the  same  opportunity 
of  learning  about  educational  tests.  In  this  connection,  it  may 
also  be  mentioned  that  a  very  large  percent  of  teachers  enter  the 
profession  each  year.  Second,  the  most  important  reason  is 
that  educational  tests  are  instruments  which  teachers  may  use  to 
increase  the  effectiveness  of  their  instructional  efforts.  But  in 
order  that  the  tests  may  fulfill  this  function,  it  is  necessary  that 
teachers  know  how  to  use  them.  To  give  them  is  merely  to  take 
the  first  step.  It  must  be  followed  by  interpretation  of  the  scores 
in  terms  of  pupil  needs  and  modification  of  instruction  in  accord- 
ance v;ith  these  needs. 

This  use  of  educational  tests  for  the  improvement  of  instruc- 
tion is  not  incompatible  with  their  use  for  supervisory  purposes, 
but  the  writer  believes  this  supervisory  use  should  not  be  empha- 
sized more  than  it  is  now  being  emphasized.  In  fact,  there  are 
cases  on  record  where  this  function  has  been  over-emphasized. 
This  tends  to  prejudice  teachers  against  the  use  of  educational 
tests  or  at  least  to  divert  their  attention  from  the  instructional 
function. 
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This  department  of  the  Journal  of  Educational  Research 
will  emphasize  the  use  of  educational  tests  for  the  improvement  of 
instruction.  It  will  welcome  communications  from  teachers  who 
have  found  the  test  helpful.  Those  who  have  secured  increased 
results  from  their  teaching  owe  it  to  the  profession  to  make 
known  their  experience.  Even  if  it  appears  commonplace,  it 
may  contain  just  the  suggestion  which  other  teachers  need. 

The  use  of  educational  tests  as  instruments  for  the  improve- 
ment of  instruction  places  them  in  the  list  of  important  school- 
room equipment.  We  consider  it  necessary  for  a  teacher  to  be 
supplied  with  blackboards,  crayon,  maps,  reference  books,  supple- 
mentary readers,  and  other  similar  equipment  in  order  that  he 
may  render  efficient  service.  On  exactly  the  same  basis,  it  is 
necessary  that  the  teacher  be  supplied  with  appropriate  educa- 
tional tests  if  his  instructional  efforts  are  to  be  most  effective. 
A  good  teacher  will,  of  course,  secure  commendable  results  with- 
out them,  but  so  will  a  good  teacher  secure  commendable  results 
without  supplementary  readers,  reference  books,  and  the  like. 
Many  boards  of  education  are  now  purchasing  educational  tests 
for  use  throughout  their  school  systems.  In  fact,  it  is  the  excep- 
tion rather  than  the  rule  when  the  teacher  is  required  to  pay  for 
the  tests.  But  definite  provision  for  the  purchase  of  testing 
materials  should  be  made  in  the  school  budget.  Until  this  is  done, 
we  cannot  say  that  they  have  official  recognition  as  important 
schoolroom  equipment. 

W.  S.  M. 

ON  THE  ORGANIZATION  OF  BUREAUS  OF  RESEARCH 

The  membership  roll  of  the  National  Association  of  Directors 
of  Educational  Research  at  this  writing  carries  sixty-seven  names 
(includes  five  honorary  members)  and,  geographically,  stretches 
from  the  Atlantic  to  the  Pacific.  This  Journal  as  an  official 
organ  will  publish  from  time  to  time  a  full  account  of  the  busi- 
ness and  activities  of  the  Association  as  well  as  special  reports 
and  news  items  dealing  with  the  work  of  particular  bureaus  in 
various  cities. 

It  is  probable,  however,  that  the  Journal  might  render  valuable 
service  of  a  little  different  type.     Research  work  in  many  school 
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systems  has  not  yet  grown  to  a  magnitude  which  warrants  the 
establishment  of  a  separate  department,  while  in  many  other  sys- 
tems newly  established  bureaus  are  struggling  and  staggering 
through  the  trying  "first  years"  of  independent  existence.  Prob- 
lems and  difficulties  without  number  are  sure  to  arise,  and  too 
often  the  person  responsible  for  "putting  measurement  across" 
in  his  school  system  must  meet  these  difficulties  and  misunder- 
standings alone.  Perhaps  he  is  the  only  person  in  the  school 
system  who  really  understands  what  educational  research  means, 
who  really  has  a  scientific  attitude  of  mind  towards  educational 
problems.  What  such  a  person  needs  in  the  first  place  is  the 
direct,  personal  sympathy  and  support  of  others  engaged  in  the 
same  work  and  struggling  with  the  same  difficulties.  Then,  in 
the  second  place,  he  needs  direct  and  immediate  help  from  those 
who  have  come  through  the  fight  successfully  and  who  know 
how  the  thing  is  done. 

It  is  the  wish  of  the  associate  editor  in  charge  of  the  work  of 
bureaus  of  research  that  his  department  may  minister  to  both 
these  needs.  He  will  enjoy  an  exchange  of  personal,  confidential 
notes  from  fellow-workers  and  will  strive  to  bring  those  whose 
difficulties  are  similar  together.  He  will  do  what  he  can  to 
answer  questions  and  give  advice,  or  to  pass  the  questions  on  to 
those  who  can  supply  the  answers.  Particularly  he  will  wel- 
come suggestions  concerning  helpful  articles  for  publication  on 
the  organization  and  activities  of  bureaus  of  research.  With  a 
field  so  large  to  choose  from  he  is  keenly  conscious  of  the  diffi- 
culties of  making  a  right  selection  and  appeals  to  all  true  friends 
of  educational  measurement  to  guide  him  in  his  editorial  duties. 


Natt0ttal  As00rtatmn  of  itr^rtnra  nf 
lEinurattnnal  H^s^arrlf 


(E.  J.  AsHBAUGH,  Secretary) 


This  department  will  be  devoted  to  the  affairs  of  the  National 
Association  of  Directors  of  Educational  Research.  Here  news  and  com- 
ment concerning  the  members  of  the  Association  and  their  work  will 
appear.  Official  announcements,  reports  of  meetings,  statements  of 
committees,  names  of  new  members,  and  many  less  formal  matters  will 
find  an  appropriate  place.  It  is  planned  that  the  "News  Letter,"  which 
has  hitherto  been  privately  circulated  among  the  members  of  the  Associa- 
tion, shall  be  given  wider  publicity  in  these  pages.  As  secretary  of  the 
Association,  Professor  E.  J.  Ashbaugh,  Extension  Division,  University 
of  Iowa,  Iowa  City,  Iowa,  is  a  member  of  the  editorial  board  of  the 
Journal  and  will  edit  this  department.  Communications  having  refer- 
ence to  the  department  should  be  addressed  to  him. 

B.  R.  B. 

ANOTHER  STEP  FORWARD 

This  is  a  time  of  advancement,  of  progress,  of  facing  forward.  The 
close  of  the  great  war  which  had  speeded  up  production  in  many  lines 
and  compelled  men  to  think  in  new  terms,  to  make  new  adjustments,  and, 
in  a  sense,  move  at  a  more  rapid  rate,  did  not  result  in  everything  settling 
back  into  the  pre-war  condition.  While  there  has  been  decreased 
activity  in  some  lines,  perhaps  even  stagnation,  in  the  realm  of  educa- 
tional thought,  the  reaction  has  not  set  in — at  least  not  yet. 

At  the  Cincinnati  meeting  of  the  Department  of  Superintendence, 
the  National  Association  of  Directors  of  Educational  Research  was 
founded.  On  that  occasion  eight  men  met  at  a  luncheon  by  an  almost 
impromptu  arrangement.  These  men  were  Ayres,  Ballou,  Buckingham, 
Courtis,  Hebden,  Melcher,  O'Hern,  and  Shiels.  This  was  in  February 
1915,  less  than  five  years  ago.  At  the  Detroit  meeting  the  following  year, 
the  first  program  was  put  on  and  the  first  banquet  was  held. 

A  year  later  a  larger  meeting  and  a  larger  group  at  the  banquet 
table  evidenced  the  fact  that  the  newly  organized  association  was  attract- 
ing the  interest  of  the  men  who  were  actively  engaged  in  this  field  of 
work.  Not  only  so,  but  the  leaders  were  ambitious  and  agreed  at  that 
time  to  produce  a  volume  for  the  National  Society  for  the  Study  of 
Education.  One  result  of  that  decision  was  Volume  II  of  the  Seven- 
teenth Year  Book.  How  far-reaching  that  decision  has  been  no  one  can 
tell.     That  the  Year  Book  has  had  a  tremenduous  influence  in  directing 
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the  thought  of  superintendents,  supervisors  and  teachers  toward  educa- 
tional measurement,  cannot  be  doubted. 

At  the  same  meeting  it  was  decided  to  circulate  a  bulletin  among  the 
members  as  a  means  of  keeping  in  touch  with  the  activities  of  each 
other.  This  bulletin  is  now  rounding  up  its  third  year.  That  it  has 
been  helpful  to  the  various  members  was  evidenced  a  year  ago  when  a 
membership  fee  was  first  levied  in  order  that  the  bulletin  might  be  con- 
tinued. 

Another  step  has  now  been  taken  by  the  Association.  By  an  almost 
unanimous  vote  the  organization  decided  to  adopt  the  new  Journal  of 
Educational  Research  as  its  official  organ.  This  journal  is  now  mak- 
ing its  bow  to  the  public,  and  the  Association  is  presenting  itself  to  a 
larger  field  than  ever  before  through  this  department  of  the  Journal. 
To  what  extent  the  Journal  will  be  beneficial  to  the  organization 
remains  to  be  seen. 

It  is  highly  important  that  with  this  new  venture,  each  member  of 
the  Association  shall  resolve  to  continue  to  advance.  The  high  ideals  of 
the  founders  of  the  Association  have  been  partly  realized.  The  dreams 
of  those  most  deeply  interested  in  it  are  continually  expanding.  That 
our  work  is  important,  we  know;  that  the  results  have  been,  and  are, 
valuable  in  our  own  local  situations,  has  been  demonstrated;  that  the 
individual  members  of  the  Association  may  make  their  work  beneficial 
to  an  ever  enlarging  group,  is  at  least  one  of  the  purposes  in  the 
adoption  of  the  Journal. 

A  large  number  of  our  members  have  been  made  contributing 
editors.  The  Association,  through  its  secretary,  is  represented  on  the 
editorial  board.  Short  news  items  concerning  the  things  the  members 
have  in  progress,  and  the  problems  they  have  in  mind,  should  be  sent  to 
the  secretary  frequently.  In  fact,  the  best  means  by  which  each  indi- 
vidual member  may  contribute  to  the  success  of  the  Association  as  a 
whole,  is  by  notifying  the  secretary  the  moment  a  new  idea  or  a  new 
plan  is  conceived. 

ACTIVITIES  OF  THE  MEMBERS 
Practically  all  directors  of  city  systems  report  the  giving  of  one  or 
more  pedagogical  tests.     An  examination  of  the  tests  used  quite  uni- 
formly shows  Courtis,  Series  B,  and  some  form  of  reading,  writing  and 
spelling. 

The  following  members  report  the  use  of  mental  tests  during  the 

current  year: 

Brainerd,  Mrs.  Margaret,  Director  of  Department  of  Reference  and 
Research,  Martin's  Ferry,  Ohio. 

Dalman,  Murray  A.,  Director  of  Department  of  Reference  and  Re- 
search, Board  of  Education,  Indianapolis,  Indiana. 
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Dickson,  Virgil  E.,  Acting  Director  of  Reference  and  Research,  Public 
Schools,  Oakland,  California, 

Henry,  Mary  Bess,  Director  of  Research,  Santa  Ana,  California. 

Lane,  Robert  E.,  Division  of  Educational  Research,  Los  Angeles,  Cali- 
fornia. 

Lefler,  M.  C,  Director  of  Measurements  and  Research,  Lincoln,  Ne- 
braska. 

Race,  Henrietta  V.,  Director  Psychological  Clinic,  Board  of  Education, 
Louisville,  Kentucky. 

Smith,  Leon  O.,  Director  Educational  Research,  Omaha,  Nebraska. 

Surveys  of  local  schools,  and  more  or  less  state-wide  testing  on 
certain  subjects  are  reported  from  the  following  state  bureaus: 
University  of  Iowa,  Iowa  City,  Iowa. 
University  of  Illinois,  Urbana,  Illinois. 
State  Normal  School,  Emporia,  Kansas. 
University  of  Nebraska,  Lincoln,  Neb. 
State  Department,  Madison,  Wis. 
University  of  Washington,  Seattle,  Wash. 

Progress  in  the  work  of  standardization  of  new  tests  is  reported  by: 
Dr.  B.  R.  Buckingham  and  Dr.  Walter  S.  Monroe,  University  of  Illinois. 
J.  C.  De  Voss,  State  Normal  School,  Emporia,  Kansas. 
Dr.  W.  W.  Theisen  and  Cecile  White  Flemming,   State  Department, 

Madison,  Wisconsin. 

Two  members — Leon  O.  Smith  of  Omaha  and  Virgil  E.  Dickson  of 
Oakland — report  the  interesting  experience  of  each  passing  through  a 
five  million  dollar  school  bonding  issue.  Reports  on  the  result  have  not 
yet  been  received. 

Many  interesting  problems  are  being  attacked  by  various  members. 
Among  those  listed  in  recent  letters  are  the  following: 
A  study  of  the  ability  of  elementary,  high  school  and  college  students  to 

discriminate  between  various  qualities  of  poetic  expression. 
The  educational  value  of  motion  pictures. 

The  influence  of  the  make-up  of  a  book  upon  the  child's  desire  to  read  it. 
Oral  presentation  vs.   written  presentation  vs.  graphic  presentation. 
The  value  of  supervision  with  the  use  of  tests  vs.  supervision  without 

the  use  of  tests. 
The  study  of  a  few  industries  fro  the  sake  of  learning  the  requirements 

of  those  industries  into  which  the  majority  of  our  school  children 

go  as  workers. 
Devising  tests  of  the  fundamentals  in  music  as  taught  in  the  primary 

grades. 
Does  departmental  teaching  result  in  better  teaching  of  mathematics? 
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To  what  extent  do  teachers  whose  class  evercises  are  aparently  of  su- 
perior merit  secure  better  results  as  measured  by  subject  matter 
tests  ? 


The  complete  program  of  the  Thursday  meeting  at  Cleveland  will 
be  printed  in  the  next  issue  of  the  Journal  of  Educational  Research. 
Plans  for  the  closed  meeting  on  Monday  will  also  be  announced.  The 
holding  of  a  closed  meeting  is  a  departure  from  previous  practice. 
Attendance  will  be  limited  to  Association  members  and  their  invited 
guests. 

The  idea  of  having  a  headquarters  hotel  at  Cleveland  seems  to  have 
met  with  general  approval.  The  following  members  have  notified  the 
president  that  they  have  reserved  rooms  at  the  Hotel  Statler: 


Murray  A.  Dalman 
James  C.  Devoss 
C.  E.  Chadsey 
Leon  O.  Smith 
William  S.  Gray 
W.  W.  Theisen 
Walter  S.  Monroe 
F.  E,   Shapleigh 
E.  J.  Ashbaugh 
Paul   H.   Hanus 


C.  W.  Flemming 
Henrietta  S.  Race 
Carter  Alexander 
Clara  L.  Mallory 
Ira  J.  Bright 
W.  E.  Haggerty 
S.  A.  Courtis 
Chas.  Fordyce 
F.  J.  Kelly 


Samuel  B.  Allison 
Charles  H.  Elliott 
W.  W.  Phelan 
Harriett    M.    Barthel- 

mess 
Arthur  W.  Kallom 
E,   L.   Thorndike 
J.  W.  Richardson 
Charles  H.  Judd 
H.  A.  Brown 


Robt.  S.  Lane 

All  new  members  and  such  old  members  as  have  not  reserved  rooms 
at  the  headquarters  hotel  should  do  so  at  once. 

It  appears  that  the  addresses  presented  at  our  last  meeting  are  not 
to  be  printed  in  the  Proceedings  of  the  N.  E.  A,  The  Proceedings  arc 
being  pretty  well  filled  up  with  addresses  and  papers  from  sections  of 
the  N.  E.  A.  and  from  affiliated  societies  whose  age  is  greater  than 
ours.  It  is  fortunate,  therefore,  that  we  now  have  a  new  means  of 
publication.  The  Journal  of  Educational  Research  offers  its  pages 
for  the  purpose.  The  secretary  gives  notice  at  this  early  date  that  those 
who  are  to  appear  on  the  program  at  Cleveland  will  be  requested  to  fur- 
nish him  with  a  copy  of  their  manuscripts. 


Meetings  of  the  State  School  Board  Association  and  the  City  Super- 
intendents' Association  of  Illinois  were  held  at  Urbana,  Illinois,  on 
October  29  and  31,  1919. 

«        •  ^     J     ^  These  two  associations  have  been  meeting  to- 

Supenntendents  ,  r       r  /-  t^       , 

,  gether  now  for  four  or  five  years.     By  thus  com- 

j,       H  M      h  bining  their  annual  meetings  they  have  in  many  ways 

brought    about    favorable    results    for    the    schools. 

Working  together  the  two  associations  had  a  large  part  in  securing  the 

passage  of  the  Hicks'  Law,  providing  larger  revenues  for  the  schools. 

One  of  the  chief  objects  of  these  meetings  is  to  create  in  board  members 

a  consciousness  of  the  importance  of  the  work  they  are  undertaking. 

Another  is  to  enable  the  superintendents  to  conduct  their  work  more 

successfully  through  the  better  understanding  that  these  joint  meetings 

permit  between  the  professional  and  lay  officers  of  the  schools. 

The  two  associations  met  jointly  during  the  afternoon  and  evening 
of  the  twenty-ninth  and  during  the  morning  of  the  thirtieth.  During  the 
afternoon  of  the  thirtieth  the  associations  met  separately. 

At  the  first  joint  session  the  general  subject  was  Physical  Education. 
Assistant  Superintendent  Ambrose  B.  Wight  of  Chicago  proposed  a 
definite  place  for  physical  education  in  each  day's  program,  specially  pre- 
pared supervisors  and  teachers,  adequate  equipment,  and  adaptation  of 
the  work  to  pupils  of  different  ages  and  maturities,  regardless  of  their 
grading  in  the  schools. 

Mr.  Charles  Krauskopf,  principal  of  the  Victor-Lawson  School  of 
Chicago,  described  the  origin  of  the  physical  education  movement  at 
Chicago,  showing  its  growth  from  formal  gymnastics  into  directed  play. 
He  told  of  the  interesting  experiment  that  is  being  tried  in  his  own  school 
in  organizing  play  activities.  He  stressed  the  idea  that  any  program 
adopted  should  be  educational  in  a  broad  sense — that  is,  should  make 
provision  for  all  the  pupils  and  develop  not  only  physique  but  also  char- 
acter. Mr.  Krauskopf  believes  that  this  type  of  physical  education 
affords  unrivaled  opportunities  for  the  development  of  desirable  traits  of 
character. 

Superintendent  R.  O.  Stoops  of  Joliet  told  about  the  experiment 
which  is  being  tried  out  in  that  city.  A  co-ordinating  board  consisting  of 
the  superintendent  of  the  elementary  schools,  the  principal  of  the  town- 
ship high  school,  the  mayor  of  the  city,  and  a  representative  of  the 
parochial  schools  has  been  formed.  By  the  use  of  additional  money 
voted  at  a  recent  election,  the  Park  Board  is  to  furnish  a  recreational 
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director  for  the  city.  The  specific  activities  are  to  be  financed  by  the 
high  school,  the  elementary  schools,  the  parochial  schools,  and  city 
parks. 

At  the  evening  session  on  October  29,  the  subject  was  "Americaniza- 
tion." Professor  Thomas  A,  Moran  of  Purdue  University  gave  a  fine 
inspirational  address  on  this  subject.  He  urged  that  the  American 
people  should  actively  take  up  their  responsibilities  to  the  immigrant. 

Superintendent  C.  R.  Reed  of  Rock  ford  responded  with  a  short  talk 
in  which  he  mentioned  somewhat  more  specifically  plans  to  be  taken  up 
among  foreign  people.  The  discussion  was  closed  by  Professor  J.  W. 
Garner  of  the  University  of  Illinois,  who  in  a  brief  but  vigorous  address 
urged  the  conservation  of  all  that  is  good  in  our  institutions,  and  the 
protection  of  these  institutions  from  the  alien  agitator. 

At  the  close  of  the  evening  program.  Dr.  B.  R.  Buckingham, 
Director  of  the  Bureau  of  Educational  Research,  presented  a  plan  for 
organizing  a  Superintendents'  Conference  under  the  auspices  of  the  Uni- 
versity. The  project  contemplates  the  meeting  of  such  a  conference 
annually  during  the  same  week  as  that  in  which  the  High  School  Con- 
ference meets.  Subsequently  at  its  business  meeting  the  Superintend- 
ents' Association  appointed  a  committee  to  consider  what  action  the 
Association  should  take  in  relation  to  this  proposal.  The  committee  is 
to  report  at  a  meeting  to  be  held  at  Springfield  during  the  week  between 
Christmas  and  New  Years. 

The  topic  of  the  meeting  the  following  morning  was  "The  Training 
of  Teachers  before  and  during  Service."  Superintendent  John  W. 
Withers  of  St.  Louis,  Missouri,  gave  the  principal  address.  He  warned 
of  the  danger  of  deterioration  in  our  schools  because  of  the  lack  of 
high  class  recruits  for  the  teaching  force.  He  urged  the  need  of  better 
salaries,  of  greater  dignity  for  the  teaching  profession,  and  of  more 
effective  leadership. 

He  saw  he  necessity  of  inducing  high  class  young  men  and  women 
to  enter  our  training  schools.  He  summarized  plans  that  had  been 
worked  out  in  St.  Louis  for  extension  courses  for  teachers  already  in 
service. 

Dean  C.  E.  Chadsey,  of  the  College  of  Education  of  the  University 
of  Illinois,  discussed  the  topic,  urging  the  need  of  higher  salaries  and 
the  value  of  securing  college  graduates  as  elementary  teachers.  The 
topic  was  further  discussed  by  Dr.  E.  H.  Taylor  of  the  Charleston  State 
Normal  School  who  suggested  among  other  things,  the  sending  out  of 
training  teachers  from  the  normal  schools  into  the  public  schools  to 
supervise  teaching;  by  President  J,  Stanley  Brown,  of  the  DeKalb  State 
Normal  School,  who  pointed  out  that  the  normal  schools  of  the  state  are 
now  handling  about  60  percent  of  their  possible  attendance  and  urged 
the  desirability  of  getting  more  young  women  to  enter  these  schools ;  and 
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by  Superintendent  T.  E.  Savage  of  Havana,  who  considered  some  of  the 
plans  specifically  adapted  to  the  smaller  cities. 

During  the  afternoon  of  October  30  the  School  Board  Association 
was  addressed  by  Mr.  W.  G.  Spurgin  of  Urbana  on  the  subject  of  "Con- 
solidation of  School  Districts  and  the  Enlargement  of  the  Territorial 
Unit."     After  the  address  a  business  session  was  held. 

At  the  same  time  the  City  Superintendents'  Association,  prior  to  the 
business  meeting,  listened  to  an  address  by  Miss  Ida  Hoffman  of  the 
East  St.  Louis  public  schools  on  "The  Teacher's  Viewpoint  of  Construc- 
tive Supervision."  She  believed  that  all  supervision  should  be  construc- 
tive, that  teachers  should  always  be  invited  to  comment  on  suggestions 
offered  and  to  oft'er  solutions  for  problems  in  supervision,  and  that  super- 
visors should  encourage  teachers  at  each  step  in  their  work  by  pointing 
out  "high  spots."  This  paper  was  discussed  by  Superintendent  H.  A. 
Perrin  of  Jacksonville,  Illinois,  who  urged  the  importance  of  standards 
of  achievement,  and  by  Superintendent  W.  R.  Curtis  of  Kewanee, 
Illinois,  who  emphasized  the  participation  of  teachers  in  supervision. 

By  having  spelling  tests  given  in  a  number  of  states,  Dr.  B.  R. 
Buckingham  secured  data  which  made  it  possible  to  add  505  new  words 
to  the  1,000  words  of  the  Ayres  Spelling  Scale.  With  the  very  generous 
permission  of  Dr.  Ayres,  this  list  together  with  the 
original  1,000  words  is  now  published  under  the  title 
Scale  Extended  of  Buckinham's  Extension  of  the  Ayres  Spelling 
Scale.  The  new  words  tended  to  be  more  difficult  than  those  of  the 
original  scale.  This  was  felt  to  be  fortunate  because  the  Ayres  Scale 
is  less  useful  for  upper  grades  than  for  middle  and  lower  grades  because 
of  the  fewness  of  the  words  at  the  high  end  of  the  scale. 

It  should  be  understood,  however,  that  the  extended  scale  does  not  in 
its  entirety  constitute  a  fundamental  vocabulary  scientifically  deter- 
mined. The  added  words  were  not  obtained,  as  were  the  original  words, 
from  tabulations  of  frequency  of  use.  They  were  selected  from  a  much 
larger  list  secured  by  taking  the  words  common  to  a  number  of  spelling 
books.  Therefore,  one  should  not  assume  that  the  505  new  words  are 
the  next  most  common  words  after  the  1,000  contained  in  the  original 
Ayres  Spelling  Scale. 

In  constructing  the  Extension,  the  words  of  the  original  scale  were 
not  disturbed.  All  of  the  new  words  are  placed  in  the  appropriate 
columns  under  the  old  words  and  printed  in  italics.  The  new  words  have 
thus  been  kept  separate  from  the  old  ones  and  a  person  who  secures  the 
Extension  also  has  the  original  Ayres  Scale  intact. 

Buckingham's  Extension  of  the  Ayres  Spelling  Scale  is  published 
by  the  Bureau  of  Educational  Research  of  the  University  of  Illinois. 
Sample  copies  will  be  sent  postpaid  on  receipt  of  10  cents.  In  quantity 
the  Scale  will  be  furnished  for  8  cents  per  copy. 
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The  first  program  meeting  of  the  Illinois  Section  of  the  Mathe- 

T,,.     .    c.    J.-  matical   Association   of   America   was   held   at   the 
Illuiois  Section 

,,  ^,         ^.    ,  University  of  Illinois  on  November  22,  1919.     There 
Mathematical  r  r        •  ,  •  ,    •     ,    ,    , 

.         .  ^.  were  fifty-nine  persons  present  which  included  some 
x\.ssoci3.rion  ^  ^  r 

visiting  high  school  teachers  of  mathematics.     The 
program  was  as  follows: 

1.  Address  by  H.  E.  Slaught,  President  of  the  Mathematical  Asso- 

ciation of  America. 

2.  Round  Table  Discussion  of  the  Topic:   "Freshman  Mathematics 

as  Related  to  Varying  Admission  Credits  from  the  High 
Schools."  Discussion  led  by  C.  E.  Comstock,  Bradley  Poly- 
technic Institute  and  M.  W.  Coultrap,  Northwestern  College. 

3.  Address:    "The  Training  of  Mathematics  Teachers,"  by  E.  B. 

Lytle,  University  of  Illinois. 

Discussed  by  Malcolm  McNeill,  Lake  Forest  College,  Bessie  I. 
Miller,  Rockford  College,  W.  J.  Risley,  James  Millikin  Uni- 
versity. 

4.  Address:     "How  Mathematicians  Work,"  by  Henry  Blumberg, 

University  of  Illinois. 

President  Slaught  outlined  the  history  of  mathematics  teacher 
organizations  in  the  United  States  and  led  up  to  the  special  need  and 
great  opportunities  for  real  service  facing  this  new  organization. 

The  discussion  of  high  school  courses  and  college  entrance  credits 
was  lively  and  suggestive  of  needed  investigations  and  standardization. 
There  seemed  to  be  a  general  feeling  that  skill  in  formal  symbolic  manipu- 
lation was  being  overemphasized  to  the  detriment  of  mathematical  think- 
ing in  problem  situations. 

Mr.  Lytle  outlined  a  course  of  training  desirable  for  all  high  school 
teachers  of  mathematics  but  remarked  that  such  standards  of  prepara- 
tion were  hardly  worth  considering  until  increased  salaries  were  suflli- 
cient  to  attract  our  ablest  men  and  women  into  the  teaching  profession. 

Mr.  Blumberg  gave  some  concrete  ways  in  which  some  great  mathe- 
maticians had  worked  and  made  a  few  generalizations  in  the  way  of 
suggestions  for  more  effective  methods  of  work. 

The  interest  exhibited  throughout  this  meeting  promises  well  for  the 
future  of  this  new  organization.  It  is  the  intention  to  hold  annual  meet- 
ings ;  and  there  is  no  reason  why  valuable  contributions  cannot  be  made 
to  investigations  in  curriculum  and  teaching  problems  in  both  high 
school  and  college  mathematics. 

The  former  officers  were  elected  for  another  year.    They  are: 

Prsident :  J.  A.  Foberg,  Craine  Junior  College. 

Secretary:   E.  B.  Lytle,  University  of  Illinois. 

Realizing  in  an  indefinite  way  the  undoubted  value  of  many  reports 
of  investigations  as  these  have  been  embodied  in  master's  and  doctor's 
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dissertations,  the  director  of  the  Bureau  of  Educational  Research  of  the 
P     ,  University  of  Illinois,  undertook  to  obtain  from  the 

_,,  -  T  •  f  rl  heads  of  the  departments  of  education  in  the  various 
colleges  and  universities  of  the  country  a  list  of  the 
authors  and  titles  of  such  dissertations  as  have  been  accepted  since  Janu- 
ary 1,  1917.  The  attempt  was  made  more  or  less  as  an  experiment. 
Unusual  interest,  however,  was  manifested  by  those  who  sent  in  material 
and  it  has  been  thought  wise  to  assemble  it  as  an  informal  report.  It 
can  hardly  lay  claim  to  completeness,  although  all  the  heads  of  depart- 
ments addressed  responded  either  by  indicating  that  they  had  nothing 
to  report  or  by  furnishing  the  desired  lists. 

A  classification  of  the  dissertations  will  be  made  so  far  as  the  titles 
make  this  possible.  It  is  estimated  that  the  material  will  constitute 
about  seventy  mimeographed  pages.  A  copy  of  the  report  will  be  sent  to 
all  those  who  contributed  to  it.  A  limited  number  of  reports  will  also  be 
offered  for  sale  at  one  dollar  each.  These  dissertations  have  sometimes 
been  printed  either  completely  or  in  the  form  of  abstract's.  These  facts 
have  been  noted  in  the  report  as  far  as  known.  Even  unpublished  dis- 
sertations may  generally  be  borrowed  for  an  individual  by  a  library. 

The  Extension  Division  of  the  University  of  North  Dakota  has  a 
Bureau  of  Educational  Cooperation  which  includes  the  activities  of  the 
State  High  School  League.  At  the  present  time  these  are  debate,  decla- 
P  .       .  mation  for  boys  and  for  girls,  music  in  its  various 

N  rth  D  k  t  forms,  and  athletics.     A  state  contest  is  held  at  the 

University  in  May  each  year.  At  the  same  time  the 
county  superintendents  and  high  school  principals  have  a  three  day 
conference.  The  director  of  extension  work,  Albert  H.  Yoder,  attempts 
to  answer  professional  questions  arising  in  connection  with  school  work. 
He  has  also  organized  a  child  welfare  department.  The  medical 
school,  state  public  health  laboratories,  departments  of  education  and 
tjsychology,  and  the  university  library  are  cooperating  in  this  work. 
A  child  welfare  clinic  was  opened  December  first.  Another  new  feature 
of  the  division  is  the  University  Extension  Reading  Course  intended  to 
supply  a  service  to  the  people  of  the  state  desiring  such  intellectual 
opportunities  as  can  be  realized  during  the  long  winter  evenings.  The 
list  this  year  contains  about  a  dozen  titles  in  as  many  fields,  as : 
Thayer,  William  Roscoe.     Theodore  Roosevelt;  An  Intimate  Biography. 

Boston:   Houghton  Mifflin  Co.,  1919. 
March,  Francis  Andrew.    History  of  the  World  War.    Philadelphia: 

J.  C.  Winston  Co.,  1918. 
Gompers,  Samuel.    American  Labor  and  the  War.    New  York:    Geo. 

H.  Doran  Co.,  1919. 
Ogg,  Frederick  Austin.    National  Progress  IQ07-17  {American  Nation 

a  History,  V.  27.)     New  York:    Harper  and  Bros.,  1918. 
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Foster,  John  Watson.  Practice  of  Diplomacy  as  Illustrated  in  Foreign 
Relations  of  the  United  States.  Boston:  Houghton  Mifflin  Co., 
1906. 

Trowbridge,  Edward  Dwight.  Mexico  Today  and  Tomorrow.  New 
York:    Macmillan  Co.,  1919. 

The  Executive  Committee  of  the  Wisconsin  State  Teachers'  Asso- 
ciation this  year  consented  to  add  an  Educational  Measurements  Section 
to  its  already  long  list  of  sectional  meetings.  Dr.  W.  W.  Theisen,  State 
.     p ,        .       .  Director  of  Educational  Measurements,  arranged 

•D  h  S    t'  ^^^  program.     The  meeting  drew  an  attendance  of 

more  than  five  hundred  even  though  scheduled  at 
the  same  hour  as  several  of  the  stronger  sections.  Following  the  pro- 
gram a  number  of  the  leaders  met  at  a  luncheon  at  the  Hotel  Wisconsin 
for  the  purpose  of  effecting  a  permanent  organization  of  educational 
research  workers.  The  new  organization  will  be  known  as  the  Wisconsin 
Educational  Research  Association.  Its  purpose  is  not  only  to  foster  edu- 
cational research  but  to  keep  members  in  touch  with  what  other  members 
are  doing  in  the  way  of  educational  investigation  and  experimentation. 

Officers  elected  were :  Superintendent  C.  J.  Anderson  of  Stoughton, 
President;  Mrs.  C.  W.  Flemming,  State  Supervisor  of  Educational 
Measurements,  Secretary-Treasurer.  Dr.  Edgar  F.  Riley  of  the  Platte- 
ville  Normal  was  chosen  president  of  sectional  meeting  for  next  year. 

At  the  last  session  of  the  Legislature  of  North  Carolina  an  appro- 
priation was  made  for  conducting  a  State  Survey.  Dr.  Frank  P. 
Bachman,  of  the  General  Education  Board  has  been  appointed  to  direct 
-J      ,  the  work.    Professor  M.  E.  Haggerty  of  the  University  of 

_       ,.  Minnesota  will  have   immediate  charge  of  the   tests  and 

Carolina  .       .  ... 

_  measurements.     Examinations   will   be   given   in   the   high 

schools  and  in  the  elementary  schools  of  both  rural  and 

urban  districts.     The  present  plan  contemplates  giving  tests  in  spelling, 

arithmetic,    reading,    algebra,    Latin,    and    English    composition.      It    is 

proposed  also  to  submit  intelligence  tests — at  least  in  a  limited  way. 

Professor  Haggerty  will  go  to  North  Carolina  about  January  first  to  take 

up  his  part  of  the  work  of  the  survey. 

An  appropriation  of  fifty  thousand  dollars  in  five  annual  payments 

has  been  granted  to  the  Iowa  Child  Welfare  Research  Station  of  the 

State  University  of  Iowa,  of  which  Dr.  B.  T.  Baldwin  is  director,  by 

Ch\A  w  If  ^^^  National  Women's  Christian  Temperance  Union, 

_,  ,    c      •  for  the  purpose  of  making  detailed  scientific  investi- 

Research  Station  .        .  ,        ,       ,  ,  , 

gation   into   the   development   and    conservation   oi 

child  life.  The  gift  is  for  research  and  the  station  will  be  given  a  wide 
range  of  freedom  in  the  selection  of  its  problems,  which  will  center 
around  the  field  of  eugenics,  nutrition,  and  the  mental  and  social  de- 
velopment of  the  child. 


IMPROVEMENT  IN  SCHOOL  SUBJECTS  THROUGHOUT 
THE  SCHOOL  YEAR 

V.  A.  C.  Henmon 
University  of  Wisconsin 

The  nature,  amount,  and  rate  of  improvement  in  the  case  of 
relatively  simple  functions  has  been  studied  in  some  detail.  The 
more  complex  abilities  in  school  subjects  have  scarcely  been 
touched.  In  discussing  improvement  in  informational,  apprecia- 
tive, analytic,  and  selective  functions,  Thorndike  pertinently 
remarks:  "It  is  a  noteworthy  commentary  on  the  newness  of 
scientific  study  of  education  that  nobody  has  yet  measured  the 
actual  progress  of  any  single  child  in  learning  any  school  subject 
for  over  a  month,  or  in  learning  any  of  the  informational  subjects 
for  even  a  week."^  Standardized  tests  which  might  be  used  for 
such  measurement  are  now  available  in  most  of  the  subjects  of 
the  elementary  school  curriculum  and  in  some  secondary  subjects. 
Ordinarily  they  have  been  administered  in  September  and  June 
and  comparisons  have  been  made  with  norms  at  the  beginning 
and  end  of  the  school  year.  Numerous  questions  arise  that  can 
not  be  answered  by  measurements  made  at  such  intervals. 
What  are  the  amount  and  rate  of  progress  throughout  the  year? 
Is  the  improvement,  which  is  practically  always  found,  uniform, 
or  is  the  improvement  rapid  in  the  early  part  of  the  year  with  a 
gradual  tapering  off  toward  the  close,  or  is  the  improvement  slow 
at  first  and  more  rapid  as  the  year  advances?  Are  there  plateaus 
in  the  progress  curve?  How  do  school  subjects  vary  in  improva- 
bility,  both  as  to  nature,  amount,  and  rate  of  gain,  and  as  to  the 

*  Thomdike,  E.  L.  Educational  psychology.  New  York:  Teachers  College,  1913, 
Volume  H:  "Psychology  of  learning,"  p.  333. 
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factors  and  conditions  which  determine  them?  How  do  indivi- 
duals differ  in  improvement?  These  and  many  other  questions 
require  more  frequent  and  detailed  records  of  progress  than  have 
hitherto  been  available. 

The  problem  of  studying  improvement  in  school  subjects 
throughout  the  year  by  means  of  standardized  tests  given  at 
monthly  intervals  was  proposed  to  Mr.  L.  J.  Coubal,  Principal  of  the 
Alice  School,  Hibbing,  Minnesota,  in  1 9 1 5 ,  as  a  thesis  for  a  bachelor's 
degree.  A  portion  of  the  material  was  later  used  by  Mr.  Edward 
Van  Landegend  for  a  study  of  individual  differences  in  improve- 
ment. The  results  of  both  studies  are  so  striking  as  to  deserve 
wider  publicity. 

Tests  were  given  to  32  pupils  of  the  second  grade,  33  of  the 
third  grade,  25  of  the  fourth  grade,  18  of  the  fifth  grade,  and  20 
of  the  sixth  grade.  Rate  and  comprehension  in  reading  were 
measured  by  Starch's  tests  in  the  fourth  grade  only,  as  alternative 
tests  could  not  be  provided  for  all  the  other  years.  The  scores 
for  rate  are  in  terms  of  the  number  of  words  read  per  second  and 
for  comprehension  in  terms  of  the  number  of  words  correctly 
reproduced.  Rate  of  writing  was  determined  for  all  the  grades, 
and  the  quality  was  rated  by  the  Ayres  scale.  Starch's  spelling 
tests,  consisting  of  one  hundred  words,  were  given  to  all  the 
grades,  the  scores  giving  the  number  of  words  correctly  spelled 
out  of  one  hundred.  Ability  in  addition,  subtraction,  multipli- 
cation, and  division  were  measured  by  the  Courtis  Standard  Re- 
search Tests,  Series  B,  Forms  1,  2,  and  3,  in  the  fourth,  fifth,  and 
sixth  grades.  The  tests,  except  in  arithmetic,  were  given  by  the 
teachers  under  very  specific  directions,  the  principal  also  being 
present.  The  tests  in  arithmetic  were  all  given  by  the  principal 
of  the  school. 

The  results  of  the  tests  appear  in  Tables  la  to  le  inclusive. 

TABLE  la.      RESULTS  OF  TESTS.      GRADE  II 


Sept. 
16 

Oct. 
14 

Nov. 
14 

Dec. 
8 

Jan. 
20 

Feb. 
17 

Mar. 
16 

Apr. 
13 

May 
11 

Gain 
thru 
Year 

STANDARD 

SCORES  FOR 

TESTS 

Sept. 

June 

Writing: 
Rate 

10.9 
27.0 
10.0 

10.4 
27.0 
11.4 

27.5 
25.7 
12.7 

24.8 
25.2 
17.2 

33.8 
30.0 
24.5 

25.9 
33.4 
22.6 

31.9 
33.4 
29.2 

33.1 
35.8 
25.6 

22.2 
8.8 
19.1 

20 
10 

31 

27 

Spelling 

6.5 

30 
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TABLE  lb.      RESULTS  OF  TESTS.      GRADE  III 


Sept. 
16 

Oct. 
14 

Nov. 
11 

Dec. 
8 

Jan. 
20 

Feb. 
17 

Mar. 
16 

Apr. 
13 

May 
11 

Gain 
thru 
Year 

STANDARD 

SCORES  FOR 

TESTS 

Sept. 

June 

Writing: 
Rate 

47.0 
37.0 
28.7 

44.0 
39.0 
30.6 

56.7 
43.0 
32.4 

51.0 

28.4 
30.2 

48.3 
39.2 

35.4 

53.8 
i3.3 
40.2 

48.6 
3S.0 
43.7 

51.8 
32.4 
51.0 

4.8 
-4.6 
22.1 

■ 

31 
27 
30 

38 

33 

Spelling 

28.9 

40 

TABLE  IC.      RESULTS  OF  TESTS.      GRADE  IV 


Sept. 
16 


Oct. 

14 


Nov. 
11 


Dec. 
8 


Jan. 
20 


Feb. 

17 


Mar. 
16 


Apr. 
13 


May 
11 


Gain 
thru 
Year 


STANDARD 

SCORES  FOR 

TESTS 


Sept.    June 


Reading: 

Rate 

Comprehension . 

Writing: 

Rate 

Quality 


1.5 
31.0 


Spelling. 


Arithmetic: 

Addition  -J     

Subtraction  i  tj  '  ' 

Multiplication  -J  „ 

Division  -J     


5.7 
2.3 
4.4 
1.4 
3.5 
1.1 


2.5 
23.2 


49.5 
36.4 


49.2 


5.0 
2.7 
3.8 
1.4 
3.5 
1.8 


2.2 
32.7 


53.1 
37.0 


39.0 


6.4 
3.1 

5.4 
3.0 
3.7 
1.3 


2.3 
36.3 


49.9 
43.8 


48.7 


7.8 
4.5 
5.8 
3.7 
5.0 
2.8 
3.1 
0.9 


2.2 
36.4 


57.7 
38.9 


45.7 


7.4 
4.1 
6.5 
4.5 
5.6 
3.5 
4.4 
0.9 


2.5 
40.9 


51.3 
43.5 


49.6 


8.5 
4.6 
7.2 
3.3 
6.0 
3.0 
4.4 
0.9 


2.7 
40.1 


65.2 
42.1 


55.4 


10.4 
7.0 
8.8 
6.5 
7.5 
5.0 
5.1 
2.1 


3.1 


52.6 
44.7 


56.1 


12.5 
8.5 
9.8 
8.0 
8.4 
5.5 
6.5 
5.0 


3.1 
40.4 


54.7 
48.0 


56.7 


11.5 
6.5 

10.8 
8.0 
9.1 
6.4 
8.2 
6.2 


1.6 
9.4 


5.2 
11.6 


15.6 


5.8 
4.3 
6.4 
6.6 
5.6 
5.3 
8.2 
6.2 


2.1 
24.0 


38.0 
33.0 


40.0 


4.0 
2.0 
4.0 
1.0 


2.4 
28.0 


47.0 
37.0 


51.0 


6.0 
3.0 
6.0 
3.0 
4.5 
1.5 
3.5 
1.0 


Complete  results  in  reading,  writing,  spelling,  and  arithmetic 
were  available  for  the  fourth  grade.  In  Figures  1-7  sohd  lines 
show  graphically  the  progress  for  this  grade  from  September  to 
May.  The  standard  September  and  June  scores  for  these  tests 
are  shown  by  dashed  lines.  In  these  figures  the  letters  along  the 
base  line  refer  to  the  months  from  September  to  May.  No 
September  scores  are  available  for  multiplication  and  division. 
Hence  no  dashed  lines  appear  in  Figures  6  and  7.  June  scores 
are  indicated  by  a  point  at  the  right  of  each  of  these  figures. 
Since  the  curves  for  the  other  grades  show  similar  tendencies,  the 
records  of  the  fourth  grade  only  will  be  used  for  this  discussion. 
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TABLE  id.      RESULTS  OF  TESTS.      GRADE  V 


Sept. 

Oct. 

Nov. 

Dec. 

Jan. 

Feb. 

Mar. 

Apr. 

May 

Gain 
thru 

STANDARD 

SCORES  FOR 

TESTS 

16 

14 

14 

8 

20 

17 

16 

13 

11 

Year 

Sept. 

June 

Writing: 

Rate 

58.3 
37.6 

65.7 

67.0 
45.6 

62.2 

69.2 

47.5 

64.9 

63.0 
47.1 

58.6 

50.6 
46.0 

61.0 

51.4 
49.3 

70.1 

53.8 
48.0 

68.3 

59.0 
52.3 

71.3 

0.7 
14.7 

17.3 

47.0 
37.0 

51.0 

57.0 

Quality 

43.0 

54.0 

61.0 

Arithmetic: 

Addition  ■  ^ 

8.2 

8.2 

10.6 

10.2 

10.8 

11.9 

13.5 

15.1 

14.5 

6.3 

6.0 

7.5 

5.2 

5.0 

6.9 

7.0 

7.1 

8.1 

11.2 

12.5 

10.2 

5.0 

3.0 

4.0 

(A.. 
Subtraction  ■)  p   ' 

6.9 

5.8 

8.7 

8.8 

10.1 

11.5 

14.6 

14.2 

16.2 

9.3 

6.0 

8.0 

4.6 

4.8 

6.4 

6.1 

8.5 

9.0 

12.0 

11.8 

13.6 

9.0 

3.0 

5.5 

Multiplication  -j 

4.3 

4.0 

7.5 

8.0 

8.8 

9.7 

10.3 

14.3 

12.8 

8.5 

4.5 

7.0 

1.8 

1.7 

4.9 

4.3 

5.4 

6.3 

7.6 

11.5 

9.6 

7.8 

1.5 

4.0 

Division  •  _ 

,K 

4.0 

4.0 

7.7 

8.1 

6.4 

10.0 

11.6 

15.2 

13.8 

9.8 

3.5 

5.0 

1.4 

1.9 

5.2 

5.6 

4.1 

7.5 

10.1 

14.1 

12.3 

10.9 

1.0 

3.0 

TABLE  le.      RESULTS  OF  TESTS.      GRADE  VI 


Sept. 
16 


Oct. 

14 


Nov. 
14 


Dec. 
8 


Jan. 
20 


Feb. 
17 


Mar. 
16 


Apr. 
13 


May 
11 


Gain 
thru 
Year 


STANDARD 

SCORES  FOR 

TESTS 


Sept.    June 


Writing: 
Rate. .. 
Quality. 


Spelling. 


Arithmetic: 
Addition  ■]  p '    ' 

Subtraction  •<     ' 

Multiplication  •?  _ 

Division  •<  „ 


62.4 


8.8 
5.6 
6.5 
4.8 
6.4 
4.6 
4.8 
3.8 


70.0 
46.7 


60.2 


8.2 
4.8 
7.3 
5.3 
7.1 
5.2 
5.6 
4.3 


81.0 
53.7 


68.7 


10.1 
7.1 
8.7 
7.1 
8.9 
6.9 
7.5 
6.4 


76.2 
55.5 


69.9 


10.0 
6.3 
8.8 
6.7 
9.0 
5.6 
6.8 
5.9 


63.7 
54.3 


60.8 


9.3 
6.2 
8.8 
7.8 
8.7 
7.4 
8.4 
7.5 


57.5 
55.8 


65.3 


10.3 
7.0 

10.0 
8.6 
9.6 
7.9 
8.8 
7.4 


62.1 
57.2 


75.3 


12.3 
10.0 
12.1 
11.1 
10.8 
9.1 
12.0 
10.4 


56.5 
57.3 


75.7 


14.0 
11.5 
12.9 
12.0 
12.0 
10.0 
12.4 
11.0 


59.6 
61.1 


80.7 


13.8 
10.3 
13.4 
11.8 
12.5 
9.4 
13.4 
12.9 


—10.4 
14.4 


18.3 


5.0 
4.7 
6.9 
7.0 
6.1 
4.8 
8.6 
9.1 


57.0 
43.0 


61.0 


7.5 
4.0 
8.0 
5.5 
7.0 
4.0 
5.0 
3.0 


65.0 
53.0 


71.0 


9.0 
5.0 
10.0 
7.0 
8.5 
5.5 
6.5 
5.0 


The  primary  purposes  of  this  study  were  (1)  to  measure  as 
exactly  as  possible  the  amount  of  improvement  throughout  the 
year,  and  in  particular  to  discover  the  effects  of  experimental 
conditions;  (2)  to  find  the  typical  curve  of  progress,  if  there  is 
one,  under  such  conditions;  (3)  to  compare  differences  in  rate  of 
progress  in  different  school  subjects;  and  (4)  to  secure  data  on  the 
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effects  of  equal  practice  on  individual  differences.  It  was  thought 
that  the  giving  of  the  tests  at  regular  intervals  might  be  a  valuable 
incentive  and  moreover  would  be  of  great  use  to  a  supervisor  in 
diagnosing  defects  in  individuals  and  detecting  inequalities  in 
emphasis  or  other  irregularities. 
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The  figures  and  tables  bring  out  certain  significant  facts: 
1.  The  astonishingly  great  amount  of  improvement. — The  effect  of 
applying  the  tests  at  regular  intervals  throughout  the  year  is 
nothing  short  of  remarkable.  This  fourth  grade  group  of  25 
pupils  began  the  year  with  scores  approximating  closely  the 
standards.  At  the  end  of  the  year  the  gains  exceeded  all  expecta- 
tions. In  rate  of  reading  the  initial  score  of  1 . 5  words  per  second 
in  September  is  considerably  below  the  standard,  while  the  May 
score  of  3 . 1  words  attains  the  standard  of  the  sixth  grade.  In 
comprehension  the  initial  score  of  31  words  reproduced  is  above 
the  standard  considerably,  rate  having  been  sacrificed  for  com- 
prehension in  the  first  month,  while  the  May  score  of  40 . 4  words 
is  again  that  of  the  sixth  grade.  In  spelling  the  September  score 
of  41 . 1  words  is  very  close  to  the  standard,  while  the  May  score 
of  56.7  words  is  almost  that  of  the  fifth  grade.  In  writing  the 
initial  scores  approximate  closely  the  standard  June  scores  for  the 
grade,  while  the  final  score  for  rate  is  that  of  the  fifth  grade  and 
for  quality  midway  between  those  of  the  fifth  and  sixth  grades.  In 
the  four  fundamental  operations  the  gains  are  even  more  striking. 
The  number  of  rights  runs  in  addition  from  2 . 3  to  6 . 5  (standards 
2 . 0  to  3 . 0) ,  in  subtraction  from  1 . 4  to  8 . 0  (standards  1 . 0  to  3 . 0) ,  in 
multiplication  from  1.1  to  6.4  (June  standard  1 . 5)  and  in  divi- 
sion the  final  score  is  6.2  (standard  1.0).     The  final  scores  in 
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arithmetic  in  attempts  and  rights  are  in  all  cases  above  the 
standards  of  the  sixth  grade  and  in  many  cases  are  above  those 
of  the  seventh  grade.  When  it  is  borne  in  mind  that  selection  by 
eliminating  the  poorer  pupils  accounts  in  some  measure  for  the 
increase  in  the  standard  scores  from  year  to  year,  the  effect  is  all 
the  more  noteworthy. 

It  should  be  noted  also  that  the  gain  in  one  subject  is  not  due 
to  overemphasis  upon  it  and  accounted  for  in  part  by  loss  in  other 
subjects.  The  results  of  a  very  large  share  of  the  instruction  of 
the  fourth  grade  were  measured  and  large  gains  are  shown  in  every 
case.  Nor  is  the  increase  due  to  constant  drill.  When  a  test 
was  completed  it  was  put  aside  and  not  used  again  till  the  end  of 
the  next  month.  No  alteration  was  made  in  the  work  of  tie 
school  except  for  the  monthly  tests.  The  regular  work  of  the 
fourth  grade  involves  a  five  to  ten  minute  daily  exercise  in  the 
four  fundamental  operations  in  arithmetic. 

The  results  are  in  accord  with  those  attained  in  laboratories 
which  have  always  shown  very  great  improvement  with  practice 
under  experimental  conditions  even  in  traits  which  in  the  ordinary 
circumstances  of  life  have  been  much  subject  to  practice.  Labora- 
tory experiments  in  memorizing,  for  instance,  have  shown  very 
great  gains  under  experimental  conditions  by  those  who  have 
memorized  more  or  less  all  their  lives  and  whose  capacities  might 
be  supposed  to  have  been  brought  near  the  limits  of  improvement. 
In  sharp  contrast  is  the  rate  of  improvement  ordinarily  found  in 
school  children  as  is  indicated  by  the  relatively  small  gain  from 
September  to  June  in  the  standard  scores. 

Certain  practical  applications  of  these  results  suggest  them- 
selves. Would  it  not  be  desirable  to  place  a  great  deal  of  school 
work  in  the  form  of  a  practice  experiment  in  which  the  pupil 
tested  himself  at  regular  intervals  by  objective  methods,  kept  his 
own  score,  and  watched  his  gain  or  loss  from  week  to  week  or 
month  to  month?  All  experiments  show  that  this  would  be  an 
extraordinary  stimulus  to  effort.  The  individual  would  be  com- 
peting not  with  others  but  with  his  own  past  performances. 
Why  should  not  a  pupil  record  at  intervals  how  fast  he  reads, 
how  much  he  comprehends  and  recalls,  how  well  he  writes  and 
spells,  where  he  stands  in  composition,  how  many  words  he 
knows  in  a  foreign  language,  how  rapidly  and  accurately  he  can 
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read  or  translate,  how  long  lie  must  study  a  lesson  assignment, 
etc.?  The  results  of  these  experiments  in  one  school  show  that 
the  experimental  conditions  subjected  the  school  to  a  healthy 
strain  and  that  an  amount  of  improvement  resulted  greater  than 
any  that  has  to  my  knowledge  been  reported. 

2.  The  rate  of  improvement. — An  inspection  of  the  figures  for 
the  fourth  grade  as  well  as  for  the  other  grades  shows  that  progress 
throughout  the  year  is  not  one  of  uniform  growth.  No  single 
curve  or  generalization  describes  all  of  the  facts,  but  a  curve  with 
a  long  slow  rise  during  the  first  half  or  two-thirds  of  a  year,  with 
a  rapid  rise  during  the  last  third,  fits  the  facts  tolerably  well. 
This  curve  differs  markedly  from  the  typical  learning  curve  which 
shows  a  rapid  rise  at  first,  followed  by  a  period  of  no  gain  or  of 
slow  gain.  Comparisons  with  the  typical  learning  curve,  where 
relatively  new  coordinations  are  set  up,  can,  of  course,  not  be 
fairly  made  since  these  curves  of  progress  in  school  subjects  are 
but  segments  of  larger  curves.  Whether  the  typical  curve  of 
progress  in  school  subjects  is  the  one  found  so  frequently  in  these 
records,  it  will  require  further  experimentation  to  determine. 
It  will  also  require  further  experimentation  to  determine  how  far 
the  long  plateau  period  in  the  early  part  of  the  year  is  necessary. 
It  is  quite  possible  that  changes  in  methods  and  devices,  or 
furnishing  other  stimulations,  might  bring  about  greater  improve- 
ment earUer  in  the  year.  At  any  rate  the  facts  stand  out  pretty 
sharply,  challenge  one's  interest,  and  invite  to  further  study. 

3.  The  differences  in  rate  of  improvement  in  the  different  sub- 
jects.— The  least  improvement  is  in  spelling  ability;  the  greatest 
in  arithmetic,  particularly  in  addition,  both  in  rate  and  accuracy. 
These  results  agree  with  those  of  Kirby.^  Arithmetical  opera- 
tions reduce  to  a  definite  number  of  combinations,  which  recur 
frequently,  are  easily  isolated  and  made  the  subject  of  training; 
the  associations  required  in  spelling  occur  less  frequently  and 
would  show  a  less  rapid  improvement.  We  are  just  at  the 
beginning  of  the  study  of  such  differences  as  these  in  school  sub- 
jects, the  types  of  learning  they  represent,  and  the  factors  and 
conditions  of  improvement.  The  nature  and  rate  of  improvement 
in  history  and  geography  differ  no  doubt  in  important  respects 

*  Kirby,  T.  J.  Practice  in  case  of  school  children.  New  York:  Teachers  College, 
1913. 
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from  those  in  reading,  writing,  spelling,  and  arithmetic.  There 
is  great  need  for  study  of  learning  processes  in  each  school  subject 
under  school  conditions,  using  standardized  tests  as  instruments 
of  analysis.     Such   tests  have  furnished   a  valuable  means  of 

TABLE   II.      INDIVIDUAL  DIFFERENCES  IN  ADDITION,  SUBTRACTION, 
AND  MULTIPLICATION  COMBINED.      GRADE  IV 


Scores  =  Sum  of  Rights  in  Courtis  Standard  Research  Tests  in  Arithmetic,  Series  B 

Pupil 

S 

0 

N 

D 

J 

F 

M 

A 

M 

Gross 
Gain 

1 

13 

1 

13 

11 

S 

15 
6 

16 
8 
6 

13 
9 
15 
10 
12 

18 
18 
25 
19 
16 

17 
22 
21 
18 

23 
14 
20 

18 

31 
31 
31 
23 
25 

35 
34 
41 
34 
29 

38 
37 
32 
31 
28 

25 

2 

36 

3 

19 

4 

20 

5 

23 

Av.  Group  I 

8.6 

10.2 

11.8 

19.2 

19.5 

18.8 

28.2 

34.6 

33.2 

24.6 

6 

2 
4 

4 
9 

5 

5 
4 

5 
7 
3 

12 
11 

8 

14 

9 

11 

15 

7 

15 
10 

11 
15 
12 
13 
14 

12 
12 
12 
15 
14 

21 
20 
25 
20 
18 

20 
28 
26 
23 
21 

28 
24 
23 
22 
20 

26 

7 

20 

8 

19 

9 

13 

•  10 

15 

Av.  Group  II 

4.8 

4.8 

10.8 

11.6 

13.0 

13.0 

20.8 

23.6 

23.4 

18.6 

11 

9 
7 
3 
1 
6 

13 
7 
6 
2 

10 

12 
6 
3 
4 

5 

17 
8 

7 
8 
7 

13 
5 
8 

10 

8 
7 
5 
9 
12 

21 
16 
14 
14 
18 

22 
16 
19 
21 
6 

18 
17 
17 
17 
16 

9 

12 

10 

13 

14 

14 

16 

15 

10 

Av.  Group  III 

5.2 

7.4 

6.0 

9.4 

9.0 

8.2 

16.6 

16.8 

17.0 

11.8 

16 

0 
0 
0 
3 
4 

0 

4 
7 
2 
3 

3 
5 

5 

2 

4 
6 
4 
11 
0 

12 
2 
9 

12 

4 

7 

10 
6 
4 
0 

10 
5 

9 
0 

13 

8 

11 

11 

16 

10 

9 

9 

6 

16 

17 

10 

18 

9 

19 

6 

20 

2 

Av.  Group  IV 

1.4 

3.2 

3.8 

5.0 

7.4 

5.4 

6.0 

10.8 

10.0 

8.6 

Class  Averages 

5.0 

6.4 

8.3 

11.3 

12.1 

10.9 

18.5 

22.0 

20.9 

15.9 
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diagnosis,  but  progress  in  therapeutics  has  not  kept  pace  with 
progress  in  diagnosis. 

4.  Individual  diferences  in  amount  and  rate  of  improvement. — 
To  what  are  the  great  gains  with  practice  due?  Are  they  due  to  a 
uniform  gain  by  all  pupils,  are  they  due  to  very  great  gains  by 
the  better  pupils,  or  are  they  due  to  large  gains  by  the  poorer 
pupils?  Do  the  initial  individual  differences  tend  to  increase  or 
decrease  throughout  the  year?  The  few  studies  that  have  been 
made  have  shown  marked  differences  in  improvement  and,  more- 
over, they  have  shown  that  individual  differences  tend  to  increase 
rather  than  to  decrease  with  equal  amounts  of  practice.^  The 
data  in  this  study  point  unmistakably  to  the  same  conclusion.    A 

TABLE  in.      INDIVIDUAL  DIFFERENCES   IN  FOUR  FUNDAMENTAL 

OPERATIONS.      GRADE  V 

Scores  =  Sura  of  Rights  in  Courtis  Standard  Research  Tests  in  Arithmetic.  Series  B 


Pupil 

S 

0 

N 

D 

J 

F 

M 

A 

Ikl 

Gross 
Gain 

1 

9 

28 

8 

18 

12 
25 
20 
20 

21 
31 
20 
31 

36 
39 
17 
34 

36 
40 
19 
30 

47 
44 
28 
39 

64 
50 
47 
47 

65 
63 
69 
43 

64 
63 
63 
56 

55 

2 

35 

3 

55 

4 

38 

Av.  GrouD  I 

15.8 

18.8 

25.8 

31.5 

31.2 

39.5 

52.0 

60.0 

61.5 

45.7 

5 

17 

11 

19 

6 

17 
11 
16 

5 

2,i 
22 
29 
21 

Z2> 
22 
34 
21 

23 
20 
17 

48 
27 
38 
20 

56 
33 
40 
31 

62 
46 

42 
53 

51 

44 
42 
41 

34 

6 

33 

7 

23 

8 

35 

Av.  Group  II 

13.3 

12.3 

26.3 

27.5 

23.3 

33.3 

40.0 

50.8 

44.5 

31.2 

9 

18 

8 

13 

7 

16 

17 
14 

7 

21 
20 
15 
11 

22 
19 
11 

23 
25 

18 

28 
20 
25 
11 

38 
31 
30 

22 

52 
37 

19 

39 

38 
33 
20 

21 

10... 

30 

11 

20 

12 

13 

Av.  Group  III 

11.5 

13.5 

16.8 

17.3 

22.0 

21.0 

30.3 

36.0 

32.5 

21.0 

Class  Average 

13.5 

15.0 

22.9 

26.2 

25.8 

31.3 

40.7 

50.1 

46.2 

32.7 

'Thorndike,  E.  L.,  Educational  psychology,  briefer  course.    New  York:  Teachers 
College,  1914.     pp.  390-94. 
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special  study  was  made  of  individual  d  fferences  in  arithmetic 
in  the  fourth,  fifth,  and  sixth  grades.  For  this  purpose  a  single 
score  or  each  pupil  was  secured  by  adding  together  the  number 
of  examples  right  in  each  of  the  four  fundamental  operations. 
In  the  fourth  grade  the  score  is  the  sum  of  the  rights  in  addition, 
subtraction,  and  multiplication,  as  the  work  in  division  was  not 
begun  until  December.  The  twenty  pupils  of  the  fourth  grade 
were  divided  into  quartiles  on  the  basis  of  the  May  score.  The 
pupils  of  the  fifth  and  sixth  grade  into  tertiles. 

Tables  II-IV  give  the  individual  group  and  class  scores  for 
each  month  and  the  gross  gains  through  the  year. 

TABLE  IV.       INDIVIDUAL  DIFFERENCES  IN  FOUR  FUNDAMENTAL 
OPERATIONS.       GRADE  VI 

Scores  =  Sum  of  Rights  in  Courtis  Standard  Research  Tests  in  Arithmetic,  Series  B 


Pupil 

S 

0 

N 

D 

J 

F 

M 

A 

M 

Gross 
Gain 

1 

28 
30 
21 
21 
23 

38 
30 
20 
19 
21 

48 
38 
36 
31 
29 

56 
45 
28 
24 
27 

50 
42 

30 

57 
48 
38 
35 
35 

69 
61 
51 
43 
46 

66 
67 
65 
56 
53 

79 
62 
61 
61 

52 

51 

2 

32 

3 

40 

4 

40 

5 

29 

Av.  Group  I 

24.6 

25.6 

36.4 

36.0 

38.8 

42.6 

54.0 

61.4 

63.0 

38.4 

6 

34 
16 

14 
9 

40 
19 
20 
21 
6 

49 
36 
28 
23 
16 

32 
34 
30 
27 
12 

36 

33 
28 
27 
21 

34 
36 
30 
27 
19 

50 
48 
41 
43 
27 

58 
48 
45 
35 
37 

49 
45 
42 
39 
39 

15 

7 

29 

8 

22 

9 

25 

10 

30 

Av.  Group  II 

18.3 

21.2 

30.4 

27.0 

29.0 

29.2 

41.8 

44.6 

42.8 

24.2 

11 

8 

12 
17 

15 
16 
10 
24 
13 

13 
18 
17 
30 
20 

12 

18 
12 
24 
12 

24 

26 
22 

21 
30 
16 

17 

35 
34 
30 

25 

27 

36 
35 
28 
28 
31 

38 
37 
35 
30 
23 

30 

12 

21 

13 

23 

14 

13 

IS 

10 

Av.  Group  III 

12.3 

19.5 

19.6 

15.6 

24.0 

21.0 

30.2 

31.6 

32.6 

19.2 

Class  Average 

19.4 

20.8 

28.8 

26.2 

31.0 

31.5 

42.0 

45.9 

46.1 

26.7 
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The  problem  of  measuring  accurately  the  amount  of  improve- 
ment with  practice,  and  especially  the  comparison  of  individuals 
with  var3dng  initial  and  final  efficiency  scores  in  amount  and 
rate  of  gain,  is  beset  with  difi&culties,  as  has  been  frequently 
pointed  out.*  While  it  is  therefore  impossible  to  state  adequately 
or  definitely  the  amounts  and  rates  of  gain  by  either  a  gross  gain 
or  a  percentile  method,  an  inspection  of  the  tables  shows  that  by 
any  rational  method  of  interpretation  the  scriptural  law  "to  him 
that  hath  shall  be  given"  holds.  Those  with  the  highest  initial 
scores  have  the  highest  final  scores  and  gain  most  both  absolutely 
and  relatively.  This  is  perhaps  best  indicated  by  expressing  the 
scores  in  terms  of  deviations  from  the  averages.  Tables  Va-Vc 
inclusive  give  these  facts  for  the  three  grades. 

TABLE  Va.   GROUP  DEVIATIONS  FROM  CLASS  AVERAGES.   GRADE  IV 


S 

0 

N^ 

D 

J 

F 

M 

A 

M 

Group  I 

+3.6 
-0.2 
+0.2 
-3.6 

+3.8 
-1.6 
+1.0 
-3.2 

+3.5 
+2.5 
-1.7 
-4.5 

+8.9 
+0.3 
-1.9 
-6.3 

+7.4 
+1.1 
-3.1 
-4.7 

+7.9 
+2.1 
-2.7 

-5.5 

+9.7 

+2.3 

-1.9 

-12.5 

+12.6 
+1.6 
-5.2 

-11.2 

+  12.3 

"      II 

+2.5 

"      III 

-3.9 

"      IV 

-10.9 

TABLE  Vb.   GROUP  DEVIATIONS  FROM  CLASS  AVERAGES.   GRADE  V 


S 

0 

N 

D 

J 

F 

M 

A 

M 

Group  I 

+2.3 
-0.2 
-2.0 

+3.8 
-2.7 
-1.5 

+2.9 
+3.4 
-6.1 

+5.3 
+  1.3 
-8.9 

+5.4 
-2.5 
-3.8 

+8.2 

+2.0 

-10.3 

+  11.3 

-0.7 

-10.4 

+9.9 

+0.7 

-14.1 

+  15.3 

"      II 

-1.7 

"      III 

-13.7 

TABLE  VC.   GROUP  DEVIATIONS  FROM  CLASS  AVERAGES.   GRADE  VI 


S 

0 

N 

D 

J 

F 

M 

A 

M 

Group  I 

+5.2 
-1.1 
-7.1 

+4.8 
+0.4 
-1.3 

+7.6 
+  1.6 
-9.2 

+9.8 

+0.8 

-10.6 

+7.8 
-0.2 
-7.0 

+  11.1 

-2.3 

-10.5 

+  12.0 

-0.2 

-11.8 

+  15.5 

-1.3 

-14.3 

+  16.9 

"      II 

-3.3 

"      III 

-13.5 

*  Thorndike,  E.  L.,  Psychology  of  learning,  1913,  pp.  165-77. 
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It  is  apparent  that  Group  I  in  each  case  deviates  farther  and 
farther  above  the  average  with  each  succeeding  month,  while 
Group  IV  in  the  fourth  and  Groups  III  in  the  fifth  and  sixth  grades 
drop  farther  and  farther  below  the  average.  The  highest  group 
progresses  with  a  marked  positive  acceleration,  while  the  lowest 
group  progresses  with  equally  marked  negative  acceleration  in 
relation  to  the  class  average.  The  result  is  that  while  Group  IV 
in  the  fourth  grade  attains  the  standard  score  of  the  grade,  Group 
I  with  an  initial  score  of  the  fourth  grade  in  June  attains  almost 
that  of  a  standard  eighth  grade.  The  range  of  variation  in  pro- 
gress in  the  fifth  and  sixth  grades  is  similarly  great — far  beyond 
the  range  of  standards  published. 

This  study  is  but  a  beginning  in  an  important  problem,  viz., 
to  record  more  accurately  than  we  have  hitherto  the  progress  of 
children  through  the  school  year.  Progress  is  determined  by  a 
great  number  of  factors  and  conditions,  all  of  which  need  to  be 
carefully  studied.  The  great  effect  of  placing  work  under  experi- 
mental conditions  as  a  stimulus  to  interest  and  effort  is  amply 
demonstrated.  Its  value  for  supervisory  purposes  i  n  diagnosis 
and  classification  is  equally  clear. 


IMPROVEMENT    OF    INSTRUCTION    THROUGH    THE 
USE   OF   EDUCATIONAL  TESTS 

Walter  S.  Monroe 
Assistant  Director  Bureau  of  Educational  Research,  University  of  Illinois 

A  few  years  ago  in  conversation  with  the  superintendent  of 
schools  in  a  city  of  about  forty  thousand  population,  I  inquired 
concerning  the  use  he  was  making  of  educational  tests;  he  replied 
that  he  was  using  tests,  that  in  fact,  he  made  it  a  point  to  give 
each  new  test  to  a  few  hundred  pupils.  He  then  made  a  very 
significant  statement.  He  said  that  he  had  given  the  Courtis 
arithmetic  tests  the  year  before,  and  that  his  teachers  had  failed 
to  find  the  pupils  doing  any  better  in  arithmetic  after  the  tests 
were  given  than  they  did  before. 

Unfortunately,  this  incident  represents  the  attitude  of  a 
considerable  number  of  users  of  standardized  tests.  They  con- 
sider such  tests  as  teaching  devices,  and  express  dissatisfaction 
with  them  when  they  do  not  cause  pupils  to  do  better  school 
work.  Others  have  thought  of  educational  tests  as  playthings 
which  they  might  use  for  their  own  entertainment  or  for  the 
entertainment  of  audiences  at  teachers'  meetings.  Beautiful 
charts  in  colored  inks  have  been  constructed  to  represent  the 
scores  obtained;  and  because  such  charts  are  new  and  tangible, 
they  have  attracted  much  attention. 

Educational  tests  are  not  playthings;  neither  are  they  teach- 
ing devices.  It  is  not  their  function  to  increase  the  abilities  of 
pupils.  They  are  designed  to  yield  information  in  the  form  of 
measures  of  the  abilities  of  pupils.  Only  as  this  information  is 
interpreted  in  terms  of  pupil  needs  and  these  are  in  turn  used  as 
a  basis  in  planning  future  instruction,  will  the  use  of  tests  increase 
abiHties. 

In  the  past  the  major  use  of  educational  tests  has  been  by 
superintendents  and  principals.  Their  purpose  has  been  to 
ascertain  how  the  pupils  of  their  schools  stood  in  comparison  with 
pupils  in  corresponding  grades  of  other  schools  or  with  reference 
to  standard  scores.    In  some  cases  the  tests  have  been  used  as  a 
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basis  for  judging  the  efficiency  of  teachers.  These  uses  are 
important  and  in  the  last  analysis  have  as  their  function  the 
improvement  of  instruction.  Educational  tests,  however,  may 
be  used  and  indeed  ought  to  be  used  directly  by  teachers  as 
instruments  for  making  more  effective  their  efforts  as  instructors. 
We  now  have  sufficient  scientific  evidence  to  show  that  the 
measurement  of  the  abilities  of  pupils  at  appropriate  intervals 
and  the  use  of  this  information  in  planning  future  teaching  will 
increase  the  abilities  of  the  pupils.  Hence,  it  is  important  that 
teachers  learn  how  to  use  standardized  tests  to  improve  instruc- 
tion. 

Giving  these  tests,  marking  the  papers,  and  tabulating  the 
scores  are  only  first  steps.  In  many  instances  beneficial  results 
have  followed  when  the  work  has  not  been  carried  beyond  this 
stage.  The  attention  of  both  pupils  and  teachers- may  thus  have 
been  directed  to  the  minimum  essentials  of  the  school  subject. 
They  may  have  been  given  a  more  definite  aim  and  a  stronger 
motive.  But,  in  order  to  reap  the  full  benefit,  the  scores  obtained 
from  giving  a  test  must  be  interpreted  in  terms  of  pupil  needs; 
and  then  the  instruction  must  be  modified  in  accordance  with  the 
interpretation.  This  article  is,  therefore,  written  to  suggest  a 
method  of  interpreting  the  scores  of  a  group  of  pupils. 

Interpretation  in  terms  of  pupil  needs  involves  more  than 
simply  ascertaining  that  the  class  median  is  above,  up  to,  or 
below  standard  or  that  certain  pupils  are  above,  up  to,  or  below 
standard.  Doing  this  is  equivalent  to  a  physician's  telling  his 
patient  that  his  temperature  is  103,  that  his  liver  is  not  func- 
tioning properly,  that  he  has  serious  indigestion,  and  that  he  is 
threatened  with  a  nervous  breakdown.  Clearly  this  is  insuf- 
ficient. If  the  physician  is  to  be  of  service  to  his  patient,  he 
must  interpret  these  fact^  in  terms  of  his  patient's  needs.  Then 
in  accordance  with  these  needs,  the  physician  must  prescribe  for 
him — for  example,  tell  him  to  eat  no  meat  or  starchy  foods,  to 
spend  several  hours  out  of  doors  each  day,  and  to  take  certain 
medicines  before  each  meal  and  at  bedtime. 

In  interpreting  scores  of  educational  tests  in  terms  of  pupil 
needs,  it  is  necessary  to  make  similar  prescriptions  of  changes  in 
instruction.  The  scores  of  the  pupils  and  of  the  class,  together 
with  the  errors,  correspond  to  the  temperature,  pulse  rate,  con- 
dition of  tongue,  location  of  pain,  etc.,  of  a  patient.     They  are 
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the  symptoms;  and  it  is  their  meanings  which  are  of  real  impor- 
tance. Besides  saying  that  the  median  of  a  certain  sixth  grade 
class  in  silent  reading  is  below  the  standard  for  the  fifth  grade 
and  that  25  percent  of  the  pupils  are  below  standard  for  the 
fourth  grade,  while  only  18  percent  are  up  to  or  above  standard, 
we  should  add  that  as  a  whole  the  class  needs  to  give  less  attention 
to  oral  reading,  that  it  needs  to  devote  a  practice  period  of  30 
minutes  a  day  to  the  silent  reading  of  simple  descriptive  prose, 
and  that  certain  specified  pupils  need  to  give  special  attention 
to  acquiring  the  meaning  of  words.  An  interpretation  may  also 
include  a  statement  that  certain  pupils  who  made  very  high 
scores  ought  to  be  promoted  to  the  next  grade,  or  that  they 
need  not  continue  to  study  silent  reading,  but  that  they  should 
spend  the  time  thus  saved  in  the  study  of  arithmetic. 

Different  classes  as  a  whole  have  different  needs,  and  the 
individual  members  of  a  class  have  a  great  variety  of  pupil  needs. 
The  first  step,  however,  in  interpreting  the  scores  of  a  class  is 
to  ascertain  the  needs  that  are  common  to  the  class  as  a  whole 
or  to  large  groups  within  the  class.  This  should  be  followed  by 
an  individual  interpretation  of  the  scores  of  those  pupils  at  the 
extremes  of  the  group,  particularly  of  those  conspicuously  below 
standard.  At  present,  we  do  not  have  sufficient  scientific  infor- 
mation to  permit  us  to  formulate  complete  statements  of  the 
pupil  needs  which  are  indicated  by  the  various  combinations  of 
symptoms.  In  the  absence  of  such  formulations,  it  will  be 
helpful  to  outline  a  general  procedure  which  may  be  followed  in 
interpreting  the  scores  of  a  class  after  they  have  been  tabulated 
on  the  class  record  sheet.  In  order  that  the  subject  may  be  as 
concrete  as  possible,  it  will  be  stated  in  terms  of  the  Courtis 
Standard  Research  Tests,  Series  B.  However,  one  can  easily 
adapt  the  general  plan  to  any  other  test. 

In  a  rough  way  we  may  group  the  great  variety  of  combina- 
tions of  scores  of  classes  under  six  cases  as  follows: 

Case  1.  Class  medians  below  standard  in  both  rate  and 
accuracy. 

Case  2.  Class  medians  for  rate  below  standard  with  satis- 
factory or  high  accuracy  medians. 

Case  3.  Class  medians  for  accuracy  below  standard  with 
satisfactory  or  high  rate  medians. 

Case  4.     Scores  of  members  of  the  class  widely  scattered. 
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Case  5.  Irregular  development;  class  medians  in  one  test  up 
to  or  above  standard  with  class  medians  in  another  test 
distinctly  below  standard. 

Case  6.  Class  medians  for  both  rate  and  accuracy  up  to  or 
above  standard  with  the  individual  scores  grouped  closely 
about  the  medians. 

Any  particular  class  may  exhibit  certain  combinations  of 
these  conditions.  For  example,  the  median  rate  in  a  test  (i.e., 
addition)  may  be  below  standard  with  a  satisfactory  or  high 
accuracy  median  and  at  the  same  time  the  scores  of  the  members 
of  the  class  may  be  widely  scattered.  Such  a  class  would  be 
considered  as  coming  under  both  Case  2  and  Case  4. 

For  each  of  these  cases,  it  is  possible  to  hst  certain  probable 
needs.  All  of  these  needs  may  not  apply  to  a  given  class  but 
some  of  them  will  almost  certainly  be  appropriate^  In  general,  it 
will  be  profitable  to  investigate  these  needs  first  and  determine 
which  of  them  apply  to  the  class  in  question.  The  most  probable 
needs  for  each  case  are  given  below. 

Case  1. — This  is  probably  a  case  of  inefiicient  teaching.  It  is 
true,  there  may  be  some  other  explanation  of  the  low  median 
scores  and  it  is  well  of  course  to  investigate  this  possibility.  For 
example,  it  may  be  suspected  that  pupils  are  below  normal  in 
general  ability,  and  evidence  on  this  question  may  be  obtained 
by  giving  a  test  of  general  intelligence.  Or,  scores  may  be  below 
standard  because  of  an  unusual  course  of  study,  and  a  comparison 
of  the  particular  course  with  a  number  of  successful  courses  may 
be  made.  Still  other  causes  may  be  responsible  to  a  greater  or  less 
extent  for  the  condition;  but  inelSicient  teaching  is  the  most 
probable  single  cause. 

Instruction  may  be  inefficient  with  respect  to  drill.  Perhaps 
more  time  should  be  devoted  to  it,  but  it  is  more  Ukely  that  the 
time  already  devoted  to  it  should  be  used  more  effectively.  Drill 
work  ought  to  be  organized  so  that  every  minute  is  used  by  every 
pupil.  Many  teachers  waste  time  by  allowing  some  pupils  to  be 
idle  while  others  are  occupied.  When  pupils  are  working  examples 
at  the  board,  some  teache*-s  dictate  one  example  at  a  time  and 
do  not  stop  the  work  until  the  slowest  pupil  has  finished.  The 
result  is  that  pupils  who  work  rapidly  are  idle  a  large  part  of 
the  time.  It  is  easy  to  carry  on  drill  work  in  such  a  way  that  loss 
of  this  kind  will  not  occur.       In  the  case  just  mentioned  the 
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amount  of  time  wasted  will  be  greatly  reduced  if  several  examples 
instead  of  one  are  dictated  at  a  time  and  the  work  stopped  as 
soon  as  the  most  rapid  workers  have  finished.  Some  teachers 
also  waste  time  in  having  purely  mechanical  work  explained  when 
the  pupils  need  drill  rather  than  explanation.  Again,  drill  may 
be  inefficient  because  of  the  failure  of  the  teacher  to  recognize 
rate  of  work  as  important.  The  need  may  be  increased  motiva- 
tion. If  this  is  the  case,  the  teacher  will  find  educational  tests 
themselves  helpful.  In  addition  he  can  make  use  of  a  variety 
of  devices  for  securing  a  stronger  motive,  including  the  assign- 
ment of  work  under  timed  conditions. 

Case  2. — The  most  probable  need  of  a  class  which  is  below 
standard  in  rate  with  satisfactory  accuracy  is  for  speed  drills.  In 
other  words,  it  is  Hkely  that  the  teacher  has  not  been  placing 
sufficient  emphasis  upon  the  rate  of  work.  A  possible  need  is 
for  the  elimination  of  time-consuming  methods  of  work,  such  as 
the  use  of  an  elaborate  phraseology  in  performing  the  operations. 
For  example,  pupils  may  be  required  to  name  eich  successive 
digit  in  adding  a  column  of  figures  instead  of  naming  only  the 
partial  sums.  In  some  cases  slow  work  is  due  to  the  failure  of 
pupils  to  concentrate  attention  upon  the  task.  Under  such 
circumstances  they  should  be  trained  in  giving  continuous  and 
undivided  attention  to  the  task  assigned.  This  includes,  among 
other  things,  the  need  for  securing  a  stronger  motive. 

Case  3. — A  low  median  score  in  accuracy  may  be  due  to  the 
fact  that,  in  working  under  the  timed  conditions  of  the  test,  the 
pupils  become  excited  and  that  in  attempting  to  do  a  large 
number  of  examples  they  become  careless.  When  this  happens, 
the  test  should  be  repeated;  and  it  is  likely  that  on  the  second 
trial,  the  median  for  accuracy  will  be  much  higher.  If,  however, 
the  condition  persists,  the  pupils  should  have  frequent  timed 
drills  under  the  conditions  of  the  test  and  should  thus  learn  to 
assume  the  proper  attitude  toward  the  test.  It  may  be  that  the 
need  is  even  more  fundamental.  There  are  many  different  types 
of  examples  in  a  given  operation — e.g.,  in  addition.  Pupils  may 
have  learned  to  do  some  types  without  having  learned  to  do 
others.  For  example,  they  may  be  able  to  add  short  columns 
without  being  able  to  add  long  columns  because  of  the  increased 
span  of  attention  required.  It  may  be  that  the  pupils  have  never 
been   given  instruction   upon   the  particular   type   of   example 
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occurring  in  the  test.    If  so,  they  need  to  be  taught  how  to  do 
this  type. 

Case  4. — When  the  scores  of  the  several  members  of  the  class 
are  too  widely  scattered,  the  probable  need  is  for  individual 
instruction.  The  form  of  this  instruction  will  depend  upon  the 
particular  needs  of  the  individual  pupils.  An  analysis  of  the 
performance  of  a  pupil  is  required  in  order  to  know  his  particular 
aieeds;  but  in  general,  the  probable  needs  of  individual  pupils  are 
•the  same  as  the  probable  needs  of  a  class.  The  conditions  occur- 
ring in  Case  4  may  often  be  met  by  promoting  certain  pupils  to 
a  higher  grade  and  demoting  others  to  a  lower  grade,  provided 
the  general  organization  of  the  school  will  permit  such  action. 
When  this  cannot  be  done,  the  teacher  must  devise  some  way  to 
give  to  each  pupil  that  instruction  which  will  meet  his  needs. 
Practice  exercises  such  as  the  Courtis  Standard  Practice  Tests^ 
have  been  designed  to  assist  in  meeting  individual  needs. 

Case  5. — Irregular  development  is  made  possible  by  the  fact 
that  there  are  a  number  of  different  types  of  examples.  Pupils 
may  and  do  learn  to  do  certain  types  without  learning  to  do 
other  types  with  anything  like  the  same  rate  and  accuracy. 
When  irregular  development  is  found  to  exist,  the  need  is  for  a 
redistribtution  of  emphasis  in  the  instruction.  Clearly,  types  for 
which  the  scores  are  low  need  to  be  given  more  emphasis  while 
those  for  which  the  scores  are  up  to  or  above  standard  need  less 
attention.  The  Courtis  Standard  Research  Tests,  Series  B,  can 
only  show  irregularities  between  the  four  fundamental  operations. 
A  series  of  diagnostic  tests  will  reveal  irregularities  between 
different  types  of  examples  within  the  same  operation. 

Case  6. — When  a  class  is  above  standard  in  all  respects  it  may 
be  thought  that  conditions  are  satisfactory  and  that  the  pupils 
have  no  needs.  This,  however,  may  not  be  true.  Among  the 
most  probable  needs  are  (1)  promotion  to  the  next  grade,  (2)  less 
time  to  this  subject  and  more  to  others,  (3)  opportunity  to  take 
up  more  advanced  topics.    The  meeting  of  these  needs  (especially 

^  The  Courtis  Standard  Practice  Tests  in  Arithmetic  (published  by  the  World 
Book  Company,  Yonkers-on-Hiidson,  New  York)  are  practice  tests  in  the  four 
fundamental  operations  with  whole  numbers.  The  complete  set  consists  of  cabinet  1 
(a  set  of  720  lesson  cards  for  a  class  of  fifty  pupils),  cabinet  2  (a  set  of  288 
lesson  cards  for  a  class  of  twenty),  a  student's  record  and  practice  pad,  a  teacher's 
manual,  and  a  teacher's  record.  A  specimen  set  may  be  obtained  from  the  pub- 
ishers  for  a  dollar. 
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the  one  involving  promotion  to  the  next  grade)  depends  on  the 
general  plan  of  organization  of  the  school.  When  a  class  is  just 
up  to  standard,  pupils  may  need  a  continuation  of  the  present 
instruction  or  they  may  now  be  ready  to  go  on  to  something  else. 

Locating  a  class  under  one  of  these  cases  and  ascertaining 
which  of  the  suggested  probable  needs  apply  are  the  first  steps 
in  interpretation.  With  the  partial  exception  of  Case  4  (irregular 
distribution  of  scores),  it  is  mass  interpretation  and  for  that 
reason  it  is  necessarily  crude.  Like  mass  instruction,  it  will  not 
fit  all  pupils.  While  the  members  of  the  class  probably  have 
some  common  needs,  there  are  also  likely  to  be  many  individual 
needs.  Thus  such  mass  interpretation  should  be  supplemented 
by  an  interpretation  of  the  scores  of  individual  pupils,  especially 
of  those  having  the  highest  and  lowest  scores. 

In  both  class  interpretation  and  individual  interpretation,  it 
is  necessary  to  remember  that  the  teacher  has  access  not  only 
to  the  scores  but  also  to  the  test  papers  which  give  the  perform- 
ances of  the  pupils  in  detail.  An  analysis  of  these  is  helpful, 
especially  where  there  is  any  uncertainty  about  the  needs  of  the 
pupils.  A  score  reveals  nothing  as  to  what  was  lacking  in  the 
mental  processes  of  the  pupil,  but  an  analysis  of  his  errors  may 
reveal  the  defect  and  suggest  corrective  instruction.  In  making 
this  analysis,  it  will  be  helpful  to  classify  the  errors  which  the 
pupil  has  made.  In  multiplication,  the  error  may  be  one  of 
multiplication,  of  placing  the  partial  products,  or  of  addition. 
In  addition,  and  to  a  less  extent  in  the  other  operations,  it  is 
frequently  impossible  to  determine  the  nature  of  the  error.  In 
such  cases,  one  should  observe  the  pupil  as  he  works  or  even 
have  him  "express  orally  his  mental  processes."  Whenever  such 
detailed  studies  of  the  performances  of  pupils  have  been  made, 
significant  facts  have  been  revealed.  This  kind  of  study  requires 
much  time,  but  the  time  is  profitably  employed. 

Although  interpretation  cannot  be  reduced  to  a  mechanical 
basis,  it  is  believed  that  the  general  procedure  just  outlined  will 
be  helpful  as  a  beginning  and  will  lead  naturally  to  the  individual 
analyses  without  which  accurate  individual  adjustments  cannot 
be  made.  The  fundamental  thing  for  the  teacher  to  bear  in 
mind  is  the  principle  that  only  when  we  interpret  the  scores  of 
a  test  in  terms  of  pupil  needs  and  modify  instruction  to  meet 
those  needs  will  educational  tests  fulfill  their  function. 


VALUE  OF  INFORMAL  TESTS  OF  READING 
ACCOMPLISHMENT 

William  S.  Gray 
School  of  Education,  University  of  Chicago 

Informal  tests,  as  the  term  is  used  in  this  discussion,  relate  to 
tests  which  are  organized  by  the  classroom  teacher  or  supervisor 
for  the  purpose  of  securing  accurate  records  concerning  the  accom- 
plishments of  pupils.  They  differ  from  standardized  tests  in  that 
they  are  not  so  carefully  organized,  they  have  not  been  given  to  a 
large  number  of  pupils  under  similar  conditions,  and  there  are  no 
standards  which  can  be  used  as  a  basis  for  comparison.  It  is 
evident  at  once  that  such  tests  have  serious  limitations  as  con- 
trasted with  the  more  elaborate  types  of  standardized  tests.  In 
recommending  their  use  in  this  discussion  it  is  not  intended  to 
urge  that  they  take  the  place  of  standardized  t^sts.  It  is  in- 
tended on  the  other  hand  to  show  that  informal  tests  must  be 
used  frequently  along  with  standardized  tests,  if  testing  is  to  be 
continuous  and  most  effective. 

Directions  for  an  informal  test  of  oral  reading  follow  in  order 
to  illustrate  the  character  of  such  tests: 

'^Measuring  the  rate  of  oral  reading. — The  simplest  measure- 
ment under  the  ordinary  conditions  of  class  work  is  probably  a 
measurement  of  the  rate  of  oral  reading.  This  record  can  be 
secured  in  any  ordinary  reading  exercise  as  follows:  Choose  for 
this  exercise  one  or  more  selections  which  the  pupils  read  early  in 
the  year.  Set  aside  a  reading  period  for  a  great  deal  of  oral  read- 
ing. Make  no  previous  assignment.  The  pupils  should  read  as 
in  ordinary  reading  lessons  without  suspecting  that  their  speed 
of  reading  is  being  recorded.  Have  at  hand  a  sufficient  quantity 
of  reading  material  so  that  no  two  pupils  read  the  same 
paragraphs. 

"The  teacher  will  need  a  reader  which  can  be  marked  freely 
with  a  pencil;  also  a  watch  with  a  second  hand.  When  a  pupil 
begins  reading,  note  the  exact  second  at  which  he  reads  the  first 
word  of  the  selection.     Follow  the  watch  carefully,  and  when 
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exactly  sixty  seconds  have  passed,  check  the  word  wliich  the 
pupil  was  reading  when  the  minute  was  up.  Let  the  pupil  con- 
tinue reading  without  interruption  to  the  end  of  the  paragraph 
as  he  would  in  any  reading  exercise.  Mate  whatever  comments 
or  ask  whatever  questions  would  be  askel  in  an  ordinary  reading 
lesson  and  then  go  on  to  the  next  pupil.  If,  during  the  reading, 
a  pupil  hesitates  a  few  seconds  because  of  a  difficult  word,  pro- 
nounce the  word  for  him  so  that  he  may  continue  reading. 

"Be  sure  that  you  mark  the  following  points  for  each  member 
of  the  class:  (a)  the  particular  part  read  by  each  pupil;  (b)  the 
point  at  which  he  began  reading;  (c)  the  point  which  had  been 
reached  at  the  end  of  sixty  seconds.  At  your  earliest  convenience 
count  the  number  of  words  read  by  each  pupil  during  the  minute. 
Count  "a"  and  "the"  and  other  short  words,  each  as  one  word. 
Record  the  total  number  opposite  the  pupil's  name  on  a  record 
sheet  which  you  will  keep  for  your  own  use.  Do  not  destroy 
these  records.  Keep  them  on  file.  They  will  be  valuable  for 
purposes  of  future  comparison. 

"This  type  of  exercise  should  be  continued  for  two  or  three 
class  periods.  Usually  a  teacher  who  tries  to  give  tests  and 
record  facts  for  the  first  time  finds  that  she  is  distracted  and 
inaccurate.  Confidence  and  skill  develop  very  rapidly,  however, 
with  practice.  Continue  the  measurements  of  the  rate  of  oral 
reading  until  you  feel  confident  that  you  can  secure  the  records 
accurately." 

There  are  three  lines  of  argument  which  can  be  advanced  in 
favor  of  informal  tests.  In  the  first  place,  the  number  of  standard- 
ized tests  in  reading  is  limited.  At  most  there  are  not  more  than 
ten  which  have  been  carefully  standardized.  Although  these 
tests  measure  the  accomplishments  of  pupils  in  several  phases  of 
reading  ability  they  do  not  include,  by  any  means,  all  of  the 
significant  phases.  Until  a  more  inclusive  set  of  reading  tests  has 
been  developed,  teachers  and  supervisors  will  have  to  organize 
informal  tests  for  their  own  use,  if  detailed  studies  of  all  phases  of 
reading  are  made.  Furthermore,  only  a  limited  number  of  tests 
appear  in  duplicate  or  triplicate  form.  Hence  only  a  few  stand- 
ardized tests  which  are  comparable  in  difficulty  can  be  given  at 
different  times  during  the  year.  It  is  evident,  therefore,  that  if 
teachers  and  supervisors  carry  on  investigations  of  reading  con- 
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tinuously,  informal  tests  must  be  used  at  frequent  intervals  to 
supplement  the  more  detailed  studies  made  through  the  use  of 
standardized  tests.  Unless  investigations  proceed  regularly  and 
systematically  throughout  the  year,  it  is  probable  that  tests  will 
be  interpreted  as  a  novelty.  Under  these  conditions  they 
fail  to  enlist  the  constructive  effort  of  teachers  for  any  significant 
period  of  time. 

In  the  second  place,  the  wide  use  of  informal  tests  brings  to 
the  teacher's  attention  accurate  data  on  which  to  base  judgments 
concerning  the  needs  of  pupils.  Teachers  have  been  justly 
criticized  in  the  past  because  they  have  proceeded  with  their  work 
too  largely  on  the  basis  of  opinion.  Standardized  tests  have 
changed  the  situation  somewhat  because  their  use  involves 
detailed  analysis,  accurate  measuring,  careful  recording,  and 
judgments  on  the  basis  of  facts.  In  order  to  provide  teachers 
with  the  necessary  means  of  securing  accurate  data  whenever 
problems  arise,  it  is  necessary  that  informal  tests  be  employed 
more  largely  than  in  the  past  as  a  part  of  the  regular  routine  of 
instruction.  The  most  significant  value  which  comes  from  the 
continuous  use  of  standardized  and  informal  tests  is  the  new 
interest  in  teaching  which  is  stimulated,  and  the  spirit  of  investiga- 
tion which  is  developed.  The  teacher  who  scrutinizes  her  work 
carefully  and  records  accurately,  becomes  more  openminded, 
more  interested  in  adequate  proofs,  and  less  willing  to  follow  the 
line  of  least  resistance  by  accepting  blindly  all  things  on  authority. 
These  results  cannot  be  secured  through  the  occasional  use  of 
standardized  tests.  They  develop  gradually  as  one  makes  con- 
tinuous use  of  recording  devices  in  careful  studies  of  classroom 
problems. 

In  the  third  place,  informal  tests  are  given  most  frequently 
under  normal  classroom  conditions.  This  is  distinctly  to  their 
advantage  because  measurements  are  of  most  significance  when 
they  are  secured  in  a  normal  recitation.  It  is  frequently  assumed 
that  when  recording  devices  are  used  regular  instruction  stops. 
This  view  has  its  origin  in  the  fact  that  standardized  tests  are  fre- 
quently given  under  somewhat  unusual  conditions.  The  fact  is 
emphasized  at  this  point,  however,  that  a  recording  device  is 
good  only  to  the  extent  that  it  fits  into  the  regular  work  of  the 
class  and  at  the  same  time  gives  a  series  of  accurate  results. 
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Measurements  are  of  greatest  value  when  they  bring  out  the  nor- 
mal facts  which  are  always  present  but  which  are  not  recorded 
for  the  most  part  in  reading  exercises.  When  asked  to  secure 
records,  teachers  should  be  sure  first  of  all  that  the  process  of 
measuring  does  not  change  materially  the  character  of  regular 
classroom  instruction.  A  normal  lesson  should  be  planned  out 
in  which  the  pupils  get  as  much  instruction  as  though  no  recording 
of  facts  was  going  on.  It  is  because  informal  tests  fit  into  such 
a  program  of  measurement  and  instruction  that  their  wide  use  is 
most  heartily  urged  at  this  point. 

Supervisors  who  plan  to  pursue  investigations  of  reading  in 
which  informal  or  standardized  tests  are  used  should  not  overlook 
the  fact  that  teachers  need  training  in  securing  records.  This 
is  a  new  type  of  classroom  technic  in  which  teachers  should  be 
instructed  just  the  same  as  when  a  new  system  of  handwriting  is 
introduced.  Many  supervisors  create  opposition  to  tests  by 
imposing  numerous  requirements  on  teachers  before  they  are 
adequately  trained  to  secure  records  or  to  understand  their 
significance.  The  approach  to  the  measurement  idea  which 
was  made  by  Superintendent  T.  W.  Callahan  of  Galesburg, 
Illinois,  is  significant  in  this  connection.  He  first  organized 
instructions  for  simple  informal  tests  of  the  rate  of  oral  reading. 
According  to  his  plan,  the  teachers  were  to  secure  records  once 
each  month  during  the  year  1918-1919.  The  following  form 
was  used  as  a  record  blank  on  which  to  show  the  results  of  the 
tests.  By  using  both  sides  of  the  card,  spaces  were  provided 
for  each  month  of  the  school  year.  The  reverse  of  the  card  is 
exactly  like  the  face  except  that  the  months  are  different. 
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Each  pupil  was  designated  by  a  letter  of  the  alphabet.  Entries 
were  made  on  the  card  according  to  the  following  directions. 
The  directions  assume  that  the  card  is  before  the  teacher  turned 
at  an  angle  of  90  degrees  to  the  right  from  its  present  position. 

"In  scoring  on  the  card,  number  the  spaces  from  left  to  right 
to  indicate  the  number  of  lines  read  per  minute.  Then  for 
example,  suppose,  pupil  C  reads  9  lines  and  makes  4  mistakes. 
In  the  space  numbered  9  place  the  letter  C  with  a  small  figure  4 
at  the  lower  right-hand  corner  of  the  letter." 

As  the  tests  continued  throughout  the  year,  the  teachers 
became  more  and  more  famiHar  with  the  methods  of  recording. 
The  significance  of  the  measurements  was  emphasized  with  each 
successive  test.  When  the  tabulations  for  the  year  were  com- 
plete, the  teachers  were  able  to  see  what  progress  had  been  made 
by  the  class  as  a  whole  and  by  individual  pupils.  The  require- 
ments were  simple  and  easily  fulfilled.  One  of  the  most  frequent 
and  significant  outcomes  of  a  series  of  informal  tests  of  this  type 
is  that  teachers  develop  an  interest  in  objective  records  of  the 
results  of  reading  instruction.  It  is  unnecessary  to  add  that  this 
is  one  of  the  important  results  which  an  expert  supervisor  will 
seek  to  secure.  It  paves  the  way  for  more  intensive  and  intelli- 
gent studies  of  reading,  and  for  keener  interest  in  the  continuous 
use  of  recording  devices. 

Karl  D.  Waldo,  while  superintendent  of  the  Sycamore  Public 
Schools,  organized  and  conducted  classroom  tests  of  reading 
which  illustrate  in  detail  the  type  of  work  which  should  be  carried 
on  regularly  in  each  classroom.  In  stating  the  reasons  for  his 
investigation  Mr.  Waldo  said:  "As  supervisor  I  naturally  watched 
the  reading  as  it  developed  through  the  phonic  method  and  com- 
pared it  with  the  work  done  under  the  word  plan  and  also  with 
the  reading  of  the  higher  grades  which  had  started  their  reading 
with  no  regular  system.  With  notebook  in  hand,  I  endeavored 
to  keep  a  record  of  the  individual  work  of  the  three  systems  for 
the  purpose  of  comparison.  These  records  were  not  very  satis- 
factory and  were  based  on  oral  reading  only,  with  no  attempt  to 
determine  the  comprehension  by  the  children  of  the  passages 
read,  other  than  that  which  could  be  shown  by  the  oral  expres- 
sion."i 

^  Waldo,  Karl  D.  "Tests  in  reading  in  Sycamore  schools,"  Elementary  School 
Journal,  15  :  251-2,  January,  1915. 
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"When  I  saw  how  inadequate  the  comparison  made  in  this 
way  proved  to  be,  I  looked  for  some  better  method  of  making  a 
record  of  the  work.  The  attempts  of  Ayres,  Courtis,  Thorndike, 
and  others  to  formulate  standard  tests  suggested  the  formation 
of  a  plan  for  more  scientific  testing  of  the  reading  work.  I  also 
wished  to  test  the  silent  rather  than  the  oral  reading,  for  the 
former  is  of  much  greater  importance,  not  only  later  in  school, 
but  in  future  life." 

Informal  tests  were  accordingly  organized  by  Superintendent 
Waldo  which  were  simple,  which  closely  resembled  the  regular 
work  of  the  school,  and  which  could  be  given  in  about  an  hour. 
The  material  selected  for  the  test  was  in  the  first  issue  of  Current 
Events,  a  school  paper,  for  the  year  1913-1914.  The  papers  were 
passed  out  and  the  pupils  were  asked  to  proceed,  when  the  signal 
to  begin  was  given,  as  they  would  in  reading  any  newspaper  article 
in  which  they  might  be  interested.  Five  minutes  were  allowed 
for  the  reading.  When  the  signal  to  stop  was  given  each  pupil 
checked  the  last  word  read  and  wrote  his  name  on  the  paper.  The 
pupils  were  then  asked  to  write  a  complete  account  of  what  they 
had  read  and  to  answer  ten  questions,  covering  the  subject- 
matter  read.  The  accomplishment  of  each  pupil  was  then  ex- 
pressed in  terms  of  his  rate  of  reading,  the  percentage  of  the  words 
reproduced,  and  a  percentage  grade  for  questions  answered 
correctly. 

The  same  procedure  was  used  in  all  grades  except  that  the 
third  and  fourth  grades  had  different  material  and  read  a  story 
of  Daniel  Boone  in  Eggleston's  Stories  of  Great  Americans  for 
Little  Americans.  The  first  test  was  given  early  in  the  school 
year.  After  six  months  a  second  test  was  given  in  the  same 
manner .  and  with  selections  of  corresponding  difficulty.  Check 
tests  were  given  to  determine  the  relative  difficulty  of  the  passage. 
The  results,  when  tabulated,  revealed  three  important  facts^ 
concerning  the  reading  in  Sycamore. 

1.  "Great  variation  exists  in  reading  ability  between  dif- 
ferent individuals  in  the  same  grade,  and  many  children  in  lower 
grades  are  much  better  readers  than  the  average  of  the  upper 
grades 

Ubid.,  p.  267. 
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2.  "In  careful  reading  the  rate  increases  but  slowly  in  school 
work  after  the  fifth  grade.  The  increase  in  comprehension, 
however,  is  regular  from  the  lower  to  the  upper  grades. 

3.  "The  third  and  fourth  grades  are  places  with  the  possibili- 
ties for  wonderful  development,  especially  in  the  mechanics  of 
reading.  The  effects  of  starting  the  reading  with  a  phonic  system 
like  the  Ward  are  not  evident  in  the  reading  of  the  upper  grades. 
Tests  tend  to  stimulate  the  work  in  reading,  but  have  more  effect 
upon  the  reading  rate  than  upon  the  ability  to  comprehend  what 
is  read." 

The  value  of  such  tests  as  an  aid  in  supervision  was  summarized 
by  Waldo  as  follows:^ 

These  statements  show  that  as  a  means  of  supervision  and  administra- 
tion, tests  Uke  this  one  are  of  much  utility.  Some  teachers  may  doubt  the 
value  of  the  superintendent's  criticism  or  may  feel  that  l^is  opinion  of  the 
work  in  their  rooms  is  unwarranted.  After  such  a  test  there  is  no  need  for 
the  superintendent  to  criticize.  The  facts  found  in  this  test  were  shown  in 
the  bimonthly  teachers'  meeting  and,  after  discussion,  were  accepted  by  the 
teachers  as  indicative  of  the  true  situation  in  the  reading  work.  Knowing 
the  situation  is  the  first  step  in  the  direction  of  effective  work,  and  after  that 
is  taken  both  teachers  and  superintendent  can,  in  cordial  co-operation,  set 
about  improving  the  reading  work. 

The  use  of  informal  tests  is  not  limited  to  elementary  school 
classes.  With  increasing  frequency  reports  are  published  dealing 
with  the  use  of  such  tests  in  high  school  classes.  Miss  Bertha  M. 
Smith  recently  reported^  the  results  of  an  investigation  which  she 
made  in  freshman  classes  of  the  high  school  on  efficiency  in 
assimilating  reading.  The  passages  chosen  for  the  test  related  to 
Dickens  and  were  taken  from  Long's  English  Literature.  After 
the  pupils  had  read  intensively  for  five  minutes  they  were  asked 
to  reproduce  what  they  had  read.  The  comprehension  scores 
were  determined  in  terms  of  the  percentage  of  the  total  number 
of  ideas  which  were  reproduced.  These  records  enabled  Miss 
Smith  to  study  the  number  and  types  of  errors  made  by  different 
pupils.  The  tests  showed  that  those  who  do  well  in  their  regular 
school  work  do  well  in  reading  tests,  and  that  those  who  do  poorly  in 
their  daily  work  do  poorly  in  the  tests.     The  tabulated  records 

» IhU.,  p.  253. 

*  Smith,  Bertha  M.  "Efl&ciency  in  assimilating  reading,"  School  Review, 
25  :  637^5,  November,  1917. 
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revealed  the  fact  that  both  good  and  poor  readers  arr  ordinarily 
classified  together  and  are  assigned  the  same  amount  of  work- 
in  commenting  on  the  injustice  of  this  situation,  Miss  Smith 
said:  "The  teacher  taking  too  much  for  granted  has,  no  doubt, 
caused  many  a  pupil  to  go  beyond  his  depth.  If  tests  were  to  be 
derived  which  would  show  what  kind  of  mind  the  pupil  has  and, 
in  some  measure,  its  capabilities;  then  if  courses  were  arranged 
in  the  curriculum  that  would  take  care  of  these  variable  types 
and  would  begin  with  them  where  their  abilities  begin,  not  so 
many  pupils  would  complain,  'I'm  not  interested.'  At  present 
the  good,  the  poor,  the  indifferent  are  grouped  in  the  same  class- 
room. Much  of  the  instruction  is  below  what  the  strong  pupil 
needs,  and  much  of  it  is  above  the  weak  pupil." 

To  remove  similar  difficulty  the  English  department  of  the  High 
School  of  the  University  of  Chicago  classifies  its  pupils  into  good, 
medium,  and  poor  readers  at  the  beginning  of  each  year,  by  means 
of  informal  tests.  Each  group  is  then  given  assignments  which 
are  adapted  to  their  capacities.  Furthermore,  the  poorer  sections 
are  given  training  in  the  art  of  effective  silent  reading  and  study. 
From  week  to  week,  informal  tests  are  given  along  those  lines 
which  have  been  selected  for  special  attention. 

Four  illustrations  have  been  given  of  the  value  of  informal 
tests  in  improving  instruction.  Work  of  this  type  is  already 
under  way  in  many  progressive  schools.  Many  teachers  and 
supervisors,  however,  have  been  somewhat  slow  in  adopting 
both  standardized  and  informal  tests  as  essential  devices  for 
securing  better  results.  Evidence  goes  to  show  that  frequent 
informal  tests  are  just  as  essential  as  books,  blackboards,  supple- 
mentary reading  material,  etc.  They  supply  the  teacher  with  the 
facts  which  are  necessary  in  a  scientific  organization  of  her  work 
from  day  to  day. 

In  most  cases  a  supervisory  officer  must  serve  as  a  progressive 
leader  in  stimulating  this  type  of  work.  Illustrations  of  such 
studies  must  be  presented  to  teachers.  The  value  of  these  inves- 
tigations must  be  emphasized.  Directions  for  carrying  on  such 
work  must  be  definitely  outlined.  Progressive  teachers  who  are 
interested  and  who  have  ability  to  organize  the  work  effectively 
must  be  selected  for  the  first  studies.  The  results  of  their  studies 
should  be  presented  to  the  teachers  in  order  that  they  may  see 
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more  clearly  the  values  to  be  derived  from  such  studies  and  the 
methods  to  be  employed.  The  supervisor  must  hold  himself 
responsible  for  assembling  scientific  reports  relating  to  the  prob- 
lems under  consideration,  and  for  their  presentation  and  inter- 
pretation to  the  teaching  staff.  No  opportunity  should  be  lost 
to  stimulate  interest  on  the  part  of  teachers  in  making  detailed 
studies  of  their  problems.  It  is  because  informal  tests  are  proving 
of  so  much  value  in  this  connection  that  their  use  has  been  so 
heartily  recommended  in  this  article. 


THE  DEVELOPMENT  OF  THE  UNIT  PLAN  OF 
PENMANSHIP  PRACTICE 

H.  C.  Walker 
Supervisor  of  Writing,  St.  Louis  Public  Schools 

The  waste  of  time  and  energy  in  teaching  muscular  move- 
ment writing  is  probably  greater  than  the  waste  in  teaching  any 
other  subject  of  the  public  school  curriculum. 

This  is  due  to  several  causes,  among  which  is  the  custom  of 
teaching  penmanship  according  to  grades  rather  than  according 
to  the  needs  of  the  children.  In  arithmetic  for  example,  the 
lower  grades  represent  elementary,  the  middle  grades  inter- 
mediate, and  the  upper  grades  advanced,  instruction.  When 
applied  to  muscular  movement  writing,  however,  the  grade  in 
which  the  child  is  working  is  often  immaterial.  It  may  impose 
upon  him  subject  matter  which  is  too  difficult  for  him  to  practice 
with  correct  habits;  and,  as  a  result  of  this,  his  progress  in  writ- 
ing may  be  retarded  rather  than  accelerated  by  his  practice. 

The  pupil  who  does  not  know  how  to  sit,  how  to  hold  his  pen 
and  how  to  use  the  correct  movement,  is  a  beginner  in  muscular 
movement  writing,  regardless  of  the  grade  in  which  he  is  work- 
ing; and  the  only  way  for  him  to  advance  is  to  practice  the  ele- 
mentary principles  until  his  incorrect  habits  have  given  place  to 
correct  habits. 

Too  often  the  retardation  of  a  child  in  writing  is  attributed 
to  lack  of  interest,  to  absence  of  natural  talent,  or  to  causes  other 
than  the  real  one.  Frequently  the  cause  of  failure  is  not  in  the 
child  himself,  but  in  the  course  of  instruction  which  does  not 
provide  him  with  the  kind  of  subject  matter  adapted  to  his 
particular  stage  of  progress. 

A  few  years  after  the  introduction  of  the  muscular  movement 
into  the  St.  Louis  Public  Schools,  we  discovered  that  the  per- 
centage of  good  writers  among  our  eighth  grade  pupils  was  below 
what  we  desired,  and  that  considering  the  time  spent  in  practice, 
the  results  were  not  as  good  as  we  had  reason  to  expect. 

When  muscular  movement  was  adopted,  the  ]  up'ls  of  all 
grades  were  on  the  same  plane  as  far  as  skill  in  this  mjthod  of 
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writing  was  concerned:  but  with  the  continued  use  of  the  plan 
some  of  the  children  showed  more  interest  in  the  writing  than 
others,  some  showed  greater  skill,  and  to  others  the  subject 
matter  of  the  lessons  was  better  adapted.  Added  to  this  was  the 
steady  influx  into  all  grades  of  outside  pupils,  some  of  whom 
had  not  had  the  same  training  as  our  own  pupils.  The  result  was 
that,  at  the  end  of  three  or  four  years,  there  were  in  every  room 
above  the  third  grade  three  distinct  groups  of  writers — the 
good,  the  mediocre,  and  the  poor. 

The  first  group  was  composed  of  pupils  who  wrote  well  in 
both  writing  practice  and  in  daily  work;  the  second  group  wrote 
ovals  and  easy  capitals,  but  could  not  apply  correct  habits  to 
the  writing  of  dijQ&cult  subject  matter,  or  to  daily  writing;  and 
the  third  could  not  even  make  ovals  with  correct  position  and 
movement.  , 

We  found  that  the  needs  of  these  three  t}  pes  of  pupils,  grouped 
together  as  a  class,  were  as  varied  as  would  be  the  needs  of  a 
class  of  pupils  in  arithmetic,  some  of  whom  had  advanced  as 
far  as  subtraction,  others  as  far  as  fractions,  and  still  others  as 
far  as  percentage. 

I  frequently  invited  the  principal  of  the  school  to  witness  with 
me  this  adverse  condition  under  which  the  teachers  and  pupils 
were  working. 

We  found  that  where  the  teacher  was  adapting  her  instruction 
to  the  needs  of  the  elementary  pupils  of  her  class,  the  intermediate 
and  advanced  pupils  were  wasting  their  time  by  needless  review; 
that  where  she  was  working  with  the  mediocre  writers,  the 
subject  matter  was  too  easy  for  the  advanced  writers  and  too 
difficult  for  the  elementary  writers;  and  that  where  she  pre- 
sented subject  matter  adapted  to  the  needs  of  the  advanced 
pupils,  the  mediocre  pupils  and  the  elementary  pupils  not  only 
failed  to  derive  benefit  from  the  practice,  but  were  actually 
accentuating  their  errors  and  establishing  bad,  rather  than  good 
habits. 

Our  first  step  toward  correcting  this  unfavorable  and  dis- 
couraging condition  was  to  organize  in  accordance  with  their 
needs  in  penmanship,  three  groups  of  writers  in  every  room, 
known  as  the  A,  the  B,  and  the  C  pupils.  The  pupils  changed 
their  seats  for  writing  practice  and  each  group  received  instruc- 
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tion  on  separate  days  while  the  other  two  groups  studied  other 
subjects.  While  this  was  in  some  respects  an  improvement  over 
the  former  plan,  it  was  very  unsatisfactory  because  of  loss  of 
writing  practice  time  for  the  pupils  who  were  using  the  writing 
hour  as  a  study  period,  and  it  was  therefore  abandoned. 

Inasmuch  as  each  teacher  had  elementary,  mediocre,  and 
advanced  pupils  in  her  room,  it  was  decided  to  form  three  adja- 
cent rooms  into  a  unit,  arrange  the  programs  so  that  the  writing 
hour  of  the  three  rooms  would  come  at  the  same  time,  and  have 
all  the  elementary  pupils  of  the  unit  go  to  one  room,  the  mediocre 
pupils  to  another,  and  the  advanced  pupils  to  another.  This  was 
done  as  an  experiment,  and  the  advantages  of  the  new  plan  were 
evidenced  at  once  by  greater  interest  on  the  part  of  both  teachers 
and  pupils,  and  in  the  very  marked  improvement  in  the  writing 
of  the  pupils  of  each  group  of  the  unit. 

Then  the  promotion  feature  suggested  itself  and  a  definite 
time  once  a  month  was  named  for  the  promotion  of  the  best 
writers  (up  to  ten)  of  each  group  of  the  unit.  The  best  writers 
of  the  highest  group  when  promoted  were  seated  in  the  lowest 
room  of  the  unit  and  allowed  to  use  the  writing  period  for  the 
study  of  other  subjects,  or  for  story  reading.  Some  even  served 
as  demonstrators  or  ''helpers"  in  the  elementary  group. 

From  this  nucleus  of  a  three-room  unit,  the  unit  plan  has 
expanded  until  at  present  seventy  of  our  schools  have  three- 
room  or  four-room  units  in  grades  from  four  to  eight,  inclusive, 
and  other  schools  are  adopting  it  as  fast  as  the  writing  depart- 
ment can  organize  the  work. 

The  three-room  grouping  in  a  twelve-room  school  is  here 
used  to  illustrate  the  operation  of  the  unit  plan. 

Rooms  1,  2,  and  3,  representing  seventh  and  eighth  grades, 
compose  Unit  1.  Rooms  4,  5,  and  6,  representing  fifth  and 
sixth  grades,  compose  Unit  2.  Rooms  7,  8,  and  9,  representing 
third  and  fourth  grades  compose  Unit  3.  The  first  and  second 
grades  are  not  included  in  the  unit  plan  of  practice. 

Each  unit  is  independent  of  the  other  units  and  the  plan  in  all 
the  units  is  the  same  as  that  here  illustrated  and  described. 

Figure  1  shows  the  seating  at  the  time  of  organization.  Class 
2  is  in  Room  2;  Class  3,  in  Room  3;  Class  4,  in  Room  1.  In 
classifying  pupils  Room  1   should  be  reserved  for  the  poorest 


Feb.  1920 


UNIT  PLAN  OF  PENMANSHIP  PRACTICE 


115 


writers  and  for  those  who  by  promotion  may  be  advanced  from 
Room  2  to  the  exemption  class  (Class  1).  When  possible  it 
will  be  well  to  make  the  elementary  class  of  Room  1  smaller  than 
the  other  classes,  so  that  the  teacher  may  give  individual  aid  to 
the  pupils  of  this  class.  The  reason  for  placing  the  lowest  class  in 
Room  1  at  the  beginning  of  the  term  is  to  permit  this  room  to 
become  the  highest  room  at  the  end  of  the  term.  This  condition 
will  result  from  promotions.    It  is  indicated  in  Figure  3. 

Figure  1 .    the  seating  of  pupils  at  the  time  of  organization. 
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Figure  2.    the  seating  of  pupils  after  the  first  promotion. 
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Figure  2  shows  the  seating  after  the  first  promotion.  Ten 
pupils  are  here  taken  as  an  example  of  the  number  promoted  from 
each  room  to  the  next  higher  room. 
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The  exemption  pupils,  Class  1,  seated  on  the  left-hand  side 
of  Room  1,  temporarily  excused  from  penmanship  practice,  are 
permitted  to  use  the  writing  time  as  a  study  period,  or  for  supple- 
mentary reading.  There  is  little  probability  that  the  writing  of 
these  pupils  will  deteriorate,  because  to  remain  in  the  Exemption 
Class,  they  must  keep  their  daily  writing  up  to  a  satisfactory 
standard. 

Figure  3.     the  seating  of  pupils  after  their  promotion 
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Figure  3  shows  the  rooms  of  the  unit  after  the  third  promotion. 
The  reader  is  to  understand  that  a  second  promotion  has  advanced 
an  additional  ten  pupils  from  each  room  to  the  next  higher  room 
and  that  now  a  third  promotion  advances  a  third  group  of  ten 
pupils  in  a  similar  way.  This  makes  thirty  exempted  pupils  in 
Room  1  as  shown  in  Figure  3.  The  elementary  class  (Class  4) 
has  been  eliminated  and  the  pupils  of  the  Exemption  Class 
(Class  1)  are  ready  to  take  up  advanced  penmanship  practice. 
Now  the  best  writers  are  in  Room  1.  Class  1  is  now  in  Room  1; 
Class  2,  in  Room  2 ;  Class  3,  in  Room  3.  The  rooms  will  retain  this 
order  until  the  end  of  the  term. 

The  exempted  pupils  (Room  1,  Class  1)  are  now  ready  to 
take  up  advanced  practice.  When  the  seats  of  Room  1  are 
filled,  the  Exemption  Class  is  formed  in  Room  3.  If  this  condition 
arises  at  all  it  will  be  found  late  in  the  school  year,  and  the  mem- 
bers of  the  Exemption  Class  may  then  be  excused  for  the  remain- 
der of  the  term. 
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The  condition  existing  after  the  exempted  pupils  in  Room  1 
have  resumed  practice  and  certain  additional  pupils  of  this  room 
have  been  exempted  and  seated  in  Room  3  is  shown  in  Figure  4. 

It  will  be  seen  that  this  plan  precludes  the  possibility  of  con- 
gestion and  that  only  those  who  can  afford  to  do  without  the 
writing  practice  are  exempted  from  it. 

Owing  to  the  varying  sizes  of  desks,  two-room  units  are  sug- 
gested for  buildings  of  eight  rooms  or  less;  three-room  units  for 
buildings  of  from  nine  to  eighteen  rooms;  four-room  units  for 
buildings  of  eighteen  rooms  or  more. 

When  possible  the  units  should  be  formed  so  as  to  avoid  making 
it  necessary  for  the  children  to  pass  from  one  floor  to  another. 

On  a  floor  of  five  rooms,  a  three-room  unit  and  a  two-room 
unit  may  be  organized,  and  on  a  floor  of  seven  rooms,  a  four- 
room  unit  and  a  three-room  unit  may  be  formed.     ' 

Figure  4.    final  plan  of  seating 
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One  of  our  principals  has  commented  on  the  Unit  Plan  as 
follows: 

The  unit  plan  is  advantageous  because  it  gives  the  pupils  who  have  not 
had  suflScient  elementary  training  in  writing  a  chance  to  acquire  this  training, 
thus  enabling  them  to  strengthen  their  foundation,  and  with  a  stronger 
foundation  to  increase  their  ability  to  write. 

The  best  writers,  if  intermingled  with  the  poorer  writers,  are  given  so 
little  attention  that  they  often  form  incorrect  habits  which  would  have  been 
avoided  if  more  attention  had  been  given  them.  The  unit  plan  gives  all 
pupils  the  same  amount  of  supervision  and  allows  them  to  undertake  work 
which  is  on  the  level  with  their  ability,  thus  encouraging  both  good  and  poor 
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pupils  to  put  forth  their  utmost  effort.  It  also  stimulates  interest  in  the 
poorer  writers  in  that  they  work  to  obtain  a  place  among  the  best  writers, 
whereas  formerly  the  poorer  pupils  lost  this  interest  because  they  were 
discouraged  when  comparisons  were  made  with  the  better  writers  of  the 
class." 

As  a  result  of  our  experience  with  this  new  plan  of  practice, 
some  interesting  facts  have  come  to  light. 

1.  The  percentage  of  "failures"  is  negligible. 

2.  The  percentage  of  good  writers  among  the  boys  is  greatly 
increased  and  in  many  cases  they  equal  or  excel  the  girls  in  writing 

3.  The  children  are  able  to  complete  their  formal  practice 
much  earlier  in  the  course  than  formerly. 

4.  The  supervision  is  greatly  simphfied.  Formerly  our  writing 
department  consisted  of  seven  members;  now  it  has  three. 

5.  The  teacher's  problem  of  instruction  is  greatly  simplified, 
and  she  is  able  to  render  not  only  more  efficient  aid  to  each  pupil 
but  to  render  it  to  a  much  larger  number  of  pupils. 

6.  The  penmanship  is  motivated  without  the  aid  of  award 
certificates  or  prizes  of  any  kind. 

7.  The  principal's  supervision  of  the  writing  is  systematized. 
During  the  writing  period  of  half  an  hour  he  may  visit  three  rooms 
and  find  the  pupils  graded  according  to  their  skill  in  penmanship. 

8.  The  unit  plan  admits  of  introducing  into  the  advanced  rooms 
of  the  unit  composition  and  story  writing  in  which  the  principles 
of  correct  writing  may  be  made  to  function.  This  kind  of  practice 
furnishes  the  connecting  link  between  formal  writing  practice 
and  daily  written  work. 


APPLICATION  OF  SCIENTIFIC  METHOD  IN 

EVALUATING  THE  SUBJECT  MATTER  OF 

SPELLERS* 

Clifford  Woody^ 
University  of  Washington 

Within  the  last  decade  the  dominant  note  in  educational  theory- 
has  been  the  social  point  of  view — that  the  needs  of  society  should 
furnish  the  end  points  of  education  and  should  serve  as  a  basis 
for  the  selection  of  subject  matter.  This  philosophy  has  been 
urged  as  applicable  to  all  phases  of  educational  activity  and  the 
insistence  on  its  application  has  resulted  in  many  recent  investiga- 
tions to  determine  scientifically  the  needs  of  society  and  the  conse- 
quent subject  matter.  In  no  field  have  these  investigations  been 
more  fruitful  than  in  spelling  and  the  educational  theorist  can 
look  with  great  satisfaction  upon  the  scientifically  determined 
lists  of  most  commonly  used  words  representing  the  social  need 
for  spelling.  But  the  realization  of  his  hope  has  merely  begun,  for 
these  scientifically  determined  lists  of  most  commonly  used  words 
will  have  little  influence  until  they  have  been  incorporated  into  the 
spellers  which  are  used  throughout  the  length  and  breadth  of  this 
country,  since  the  textbook  has  become  such  a  dominant  force  in 
the  life  of  the  American  teacher  that  it  tends  to  determine 
the  aims,  the  subject  matter,  and  the  method  of  instruction.  The 
use  of  the  properly  constructed  textbook  then  is  the  real  answer  to 
the  theorist's  demand  for  emphasis  on  the  social  point  of  view. 

The  present  study  was  undertaken  to  show  the  possibility  of 
evaluating  the  subject  matter  of  spellers  and  of  scientifically 
selecting  a  book  having  its  vocabulary  made  up  of  the  most 
commonly  used  words.  It  represents  a  comparison  of  the  Ander- 
son list  of  most  commonly  used  words — a  list  containing  3,105 
words  used  5  or  more  times  selected  from  the  361,184  running 
words  which  composed  the  contents  of  3,723  business  and  social 
letters  written  by  adults — and  the  vocabularies  of  five  widely  used 

*The  statistical  tabulations  utilized  in  this  article  were  made  by  Frank  S. 
Salisbury  and  the  author  is  indebted  to  him  for  the  privilege  of  using  them  in  this 
article. 
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spellers:  1)  Champion  Spelling  Book,^  2)  Peirce  Spellers,^  3)  Mer- 
rill Speller,^  4)  Aldine  Spellers*  5)  The  Child's  Own  Spelling 
Book}  The  Anderson  list®  was  selected  because  it  represents  the 
latest  and  most  comprehensive  of  all  the  attempts  to  select  the 
most  commonly  used  words  and  includes  a  very  large  percent  of 
the  Ayres  and  Pryor  lists.  The  first  three  spellers  mentioned  were 
selected  because  they  are  widely  used  in  the  state  of  Washington; 
the  fourth  one,  because  the  preface  indicates  that  the  vocabulary 
researches  have  been  utilized  to  a  considerable  extent  in  the  word 
content  of  the  book;  the  fifth  one,  because  its  subject  matter 
stands  as  the  direct  product  of  a  study  of  children's  writing 
vocabularies.  In  making  these  comparisons,  the  subject  matter 
of  the  different  spellers  was  the  only  factor  taken  into  considera- 
tion— no  attention  being  given  to  physical  features  of  the  books, 
provisions  for  review,  suggestions  for  teachers,  suggested  methods, 
gradation  of  words,  or  price.  It  is  true  that  a  complete  survey  of 
the  books  demands  that  all  these  factors  be  given  due  considera- 
tion but  in  the  selection  of  a  speller  it  is  assumed  that  the  spelling 
vocabulary  is  of  primary  importance. 

In  making  the  tabulations  the  words  of  the  Anderson  list  were 
transcribed  onto  three  by  five  inch  cards — one  word  being  placed 
on  a  card — and  the  cards  were  arranged  alphabetically,  indexed, 
and  filed.  Word  by  word,  the  vocabulary  of  each  speller  was 
checked  with  the  words  of  the  Anderson  list.  Records  were 
made  of  the  words  common  to  a  particular  speller  and  to  the  list, 
of  the  words  that  were  in  the  list  but  not  in  the  particular  speller, 
and  of  those  words  that  were  in  the  particular  speller  but  not  in 
the  list.     Hereafter  reference  will  be  made  to  these  groups  of 

'  Hicks,  W.  E.  Champion  spelling  book  for  public  and  private  schools.  New  York: 
American  Book  Co.,  1909.    2  pts. 

«  Peirce,  W.  N.     Peirce  spellers.     New  York:  Ginn  &  Co.,  1912-13.     2  bks. 
» Wilson,  J.  O.    Merrill  speller.    New  York.     Charles  E.  Merrill,  1912.     2  bks. 

*  Bryce,  C.  T.  and  Sherman,  F.  J.  Aldine  spellers.  New  York:  Newson  &  Co., 
1916.    4  bks. 

*  Jones,  W,  F.  Child's  own  spelling  book.  Pierre,  S.  D.:  Capital  Supply  Co., 
1915.     2  bks. 

'  Anderson,  W.  N.  The  determination  of  a  spelling  vocabulary  based  upon  written 
correspondence.  Master's  dissertation,  University  of  Iowa,  1917.  This  list  is  sub- 
stantially reproduced  in  E.  J.  Ashbaugh's  Iowa  spelling  scale  for  grades  II  to  VIII 
(University  of  Iowa  Extension  Bulletin,  no.  34-36,  September  1 — October  1,  1919). 
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words  as  "overlap"  words,  "list  only"  words,  and  "speller  only" 
words. 

Wherever  a  word  in  the  list  occurred  more  than  once  in  a 
particular  book  the  fact  was  noted  and  in  estimating  the  amount 
of  overlapping  such  a  word  was  given  but  a  single  count.  It  was 
originally  intended  to  record  the  repetitions  for  the  "speller  only" 
words,  but  since  the  primary  interest  of  the  study  lay  in  the  over- 
lapping of  the  spellers  with  the  Anderson  list  and  since  the  repeti- 
tion of  the  "speller  only"  words  would  have  no  bearing  on  the 
problem  save  on  total  number  of  words  in  the  different  books, 
the  amount  of  repetition  was  estimated  as  existing  in  the  same 
ratio  as  the  repetition  in  "overlap"  of  the  list  and  a  particular 

TABLE  I.      GROSS  COMPARISONS  OF  THE  FIVE  SPELLERS  WITH  THE 

ANDERSON  LIST 


Spellers 

Grades 

Total 

Words 

in  Book 

"Speller 
Only" 
Words 

"Over- 
lap" 
Words 

"List 
Only" 
Words 

Percent 
of  Book 
Repre- 
sented 
by 
"Overlap" 

Percent  of 
Anderson 

List 
Included 

/ 

2 

3 

4 

5 

6 

■  '    7 

s 

Champion 

3-8 

6,270 

(5,872) 

4,846 
(4,430) 

1,424 

1,681 

22.7 

(24.2) 

45.9 

Peirce 

3-8 

2,991 
(2,862) 

2,207 

(2,078) 

784 

2,321 

26.2 
(27.0) 

25.2 

Merrill . . . 

3-8 

5,636 
(5,550) 

3,959 

(3,873) 

1,677 

1,428 

30.0 
(30.0) 

54.0 

Aldine .  .  . 

1-8 

4,786 
(4,436) 

2,801 
(2,451) 

1,985 

1,120 

41.5 

(44.9) 

63.9 

Jones 

2-8 

4,532 

2,637 

1,895 

1,210 

41.8 

61.3 

The  figures  without  parentheses  in  columns  o,  4,  and  7  are  only  appro .\imately 
true,  for  as  was  noted  previously  only  the  gross  number  of  "speller  only"  words  was 
obtained,  the  amount  of  repetition  therein  being  disregarded.  Hence  a  slight  source 
of  error  in  the  figures  of  these  columns.  The  figures  in  parentheses  in  the  columns 
represent  the  same  results  on  the  assumption  that  the  repetition  in  the  "speller  only" 
words  is  the  same  as  in  the  "overlap"  words. 
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speller.  Record  was  also  kept  of  the  particular  grade  in  which 
each  word  in  each  speller  was  taught. 

The  facts  concerning  the  overlapping  of  the  five  spellers  and 
the  Anderson  list  are  presented  in  Table  I.  The  first  column  of 
this  table  gives  the  name  of  the  speller;  the  second  column,  the 
grades  in  which  it  is  supposed  to  be  used;  the  third  column, 
the  total  number  of  words  in  the  book;  the  fourth  column,  the 
number  of  "speller  only"  words;  the  fifth  column,  the  number 
of  "overlap"  words,  i.e.,  words  common  to  the  speller  and  the  list; 
the  sixth  column,  the  "list  only"  words,  i.e.,  words  in  the  Ander- 
son list  but  not  included  in  the  book;  the  seventh  column,  the 
percent  of  the  total  number  of  words  in  the  speller  represented 
by  the  "overlap"  words;  the  last  column,  the  percent  of  the 
Anderson  list  incorporated  in  the  speller. 

Table  I  makes  it  evident  that  if  the  number  of  words  included 
in  the  "overlap"  (column  5),  or  if  the  percent  of  the  Anderson 
list  included  in  the  "overlap"  (column  8)  is  taken  as  a  basis  of 
comparison,  the  relative  standing  of  the  books  is  as  follows: 
Aldine  first,  with  1,985  "overlap"  words  representing  63 . 9  per- 
cent of  the  Anderson  list;  Jones  second,  with  1,895  "overlap" 
words  representing  61.3  percent  of  the  Anderson  list;  Merrill 
third,  with  1,677  "overlap"  words  representing  54.0  percent  of 
the  Anderson  list;  Champion  fourth,  with  1,424  "overlap"  words 
representing  45.9  percent  of  the  Anderson  list;  Peirce  fifth,  with 
784  "overlap"  words  representing  but  25.2  percent  of  the  Ander- 
son list. 

To  the  practical  minded  superintendent  the  above  compari- 
son is  fair  and  just  for  since  the  speller  determines  to  so  great  an 
extent  what  words  will  be  taught  it  is  logical  to  insist  that  the 
subject  matter  of  that  book  is  best  which  contains  the  greater 
number  or  percent  of  the  commonly  used  words.  However, 
the  Champion,  the  Peirce,  and  the  Merrill,  as  shown  in  column  2, 
are  intended  for  grades  in  to  viii — inclusive;  the  Aldine,  for 
grades  i  to  viii  inclusive;  and  the  Jones,  for  grades  ii  to  viii 
inclusive.  Consequently  one  might  expect  differences  in  the 
total  number  of  words  in  the  spellers  and  more  chances  of  over- 
lapping in  those  books  containing  the  most  words.  Column  3 
shows  that  the  books  do  vary  greatly  in  the  total  number  of  words 
included — from  2,991  in  the  Peirce  speller  to  6,270  in  the  Cham- 
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pion — but  comparisons  with  other  columns  in  the  table  show  little 
relation  between  the  number  of  words  in  the  book  and  the  amount 
of  overlapping.  Column  7  shows  that  in  the  Aldine  and  Jones 
spellers  the  "overlap"  is  a  little  over  40  percent  of  the  total 
spelling  vocabulary  while  in  the  other  spellers  it  ranges  from  22.7 
to  30  percent.  Such  facts  tend  to  show  the  superiority  of  these 
first  mentioned  spellers. 

To  eliminate*  the  charge  that  it  is  unfair  to  compare  books 
primarily  intended  for  grades  iii  to  viii  inclusive  with  those 
intended  for  more  than  these  grades,  comparisons  were  made 
disregarding  the  word  lists  in  the  Aldine  and  the  Jones  spellers 
intended  for  grades  below  the  third.  From  Table  II  representing 
such  comparison  it  is  seen  that  the  Jones  and  Aldine  spellers  still 
rank  very  high  in  the  number  and  percent  of  the  Anderson  lists 
included  in  the  "overlap"  but  the  Merrill  speller  ranks  higher. 
When  comparison  ils  made  of  the  percent  of  the  book  total  repre- 

TABLE  II.      COMPARISON  OF  THE  FIVE  SPELLERS  WITH  THE 

ANDERSON  LIST  ON  THE  BASIS  OF  THE  WORD  LIST  FOR 

GRADES  III  TO  VIII  INCLUSIVE 


Speller 

Grades 

Total 

Words 

in  Book 

"Speller 
Only" 
Words 

"Over- 
lap" 
Words 

"List 
Only" 
Words 

Percent 
of  Book 
Repre- 
sented 
by  "Over- 
lap" 

Percent 
of  Ander- 
son List 
Included 
in  "Over- 
lap" 

1 

z 

i 

4 

5 

6 

7 

S 

Champion 

3-8 

6,270 
(5,872) 

4,846 
(4,430) 

1,424 

1,681 

22.7 
(24.2) 

45.9 

Peirce .... 

3-8 

2,991 

(2,862) 

2,207 
(2,078) 

784 

2,321 

26.2 
(27.0) 

25.2 

Merrill .  .  . 

3-8 

5,636 

(5,550) 

3,959 

(3,873) 

1,677 

1,428 

30.0 
(30.0) 

54.0 

Aldine.  .  . 

3-8 

3,888 
(3,400) 

2,429 
(1,941) 

1,459 

1,646 

40.0 
(43.0) 

47.0 

Jones .... 

3-8 

4,008 

2,524 

1,484 

1,621 

37.0 

47.7 
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sented  by  the  "overlap"  then  it  is  clear  that  the  Jones  and  the 
Aldine  spellers  contain  a  much  smaller  percent  of  words  of  "low 
probability  of  usefulness." 

Thus  far  all  comparisons  have  been  made  with  the  Anderson 
list  as  a  whole;  but,  as  was  pointed  out  by  Ayres  in  his  attempt  to 
identify  the  two  thousand  most  commonly  used  words,  the 
greater  the  number  of  words  the  more  they  vary  according  to 
the  subject  matter  under  consideration,  and  the  less  reliable  the 
conclusion  about  their  being  most  commonly  used.  Consequently 
the  Anderson  list  was  divided  into  six  parts.  Part  I  consists  of 
the  79  words  that  make  up  the  first  five  deciles  of  the  Anderson 
list,  i.e.,  those  words  which  with  all  their  repetitions  account  for 
five- tenths  of  the  361,184  running  words  that  are  contained  in  the 
Anderson  source  material.  Part  II  consists  of  the  213  words  in 
the  sixth  and  seventh  deciles.  Part  III  consists  of  the  303  words 
of  the  eighth  decile.  Part  IV  consists  of  the  849  words  of  the 
ninth  decile;  Part  V  consists  of  1,661  words  of  the  tenth  decile  which 
were  used  5  or  more  times.  Part  VI  consists  of  the  remaining 
6,118  words  of  the  tenth  decile — those  words  in  the  Anderson 
source  material  but  not  listed  as  most  commonly  used  words. 

The  number  of  words  in  the  different  parts  together  with  the 
variation  of  the  number  of  times  the  different  words  were  used 
are  presented  in  tabular  form  below. 

TABLE  III.      SHOWING  NUMBER  OF  WORDS  IN  THE  DIFFERENT 
PARTS  AND  THE  VARIATION  IN  THE  NUMBER  OF  TIMES 
THE  VARIOUS  WORDS  USED 


Number  of  Parts 

Number  of  Words 

Range  in  Number 
of  Times  Used 

I 

79 

677—11,893 

n 

213 

185—675 

m 

303 

79—185 

IV 

849 

24^79 

V                   ] 

1,661 

5—24 

VI 

6,118 

1—5 

A  glance  at  Table  III  shows  that  each  part  varies  in  two 
respects,  the  number  of  words  and  the  number  of  times  the  words 
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were  used.  It  is  furthermore  noted  that  where  there  are  few  words 
in  a  part  they  arc  used  many  times  and  where  there  are  many 
words  they  are  used  few  times.  "Few  words  and  many  times 
used"  signifies  most  commonly  used  words,  and  ''many  words 
and  few  times  used"  signifies  words  of  low  probability  of  use- 
fulness. Consequently  that  book  which  contains  the  highest 
number  and  percent  in  the  first  parts  of  the  list  will  contain  the 
most  of  the  commonly  used  words. 

Table  IV,  showing  the  number  of  words  in  the  five  spellers 
that  are  found  in  each  of  the  six  parts  of  the  Anderson  source 
material,  reveals  great  variation  among  the  different  books  in  the 
number  of  words  found  in  the  respective  parts.  It  is  interesting 
to  note  that  the  Aldine  and  the  Jones  spellers  usually  contain 
more  words  in  Parts  I  to  V  inclusive  and  fewer  words  in  Part  VI. 
These  facts  stand  out  more  prominently  in  Table  V,  which  pre- 
sents the  figures  for  Parts  I  to  V  inclusive  reduced  sto  percents. 


TABLE   IV.   NUMBER   OF   WORDS  IN   THE  FIVE   SPELLERS   THAT  ARE 
FOUND  IN  EACH  PART  OF  THE  ANDERSON  SOURCE  MATERIAL 


Spellers 

with  Book 

Total 

Parti 

(79 
words) 

Part  11 

(213 
words) 

Part  III 

(303 
words) 

Part  IV 

(849 
words) 

PartV 
(1,661 
words) 

Part  VI 
(6,118 
words) 

Champion 
5,872-6,270 

19 

113 

181 

452 

659 

4,500-4,800 

Peirce 
2,862-2,991 

8 

52 

88 

255 

381 

2,000-2,200 

Merrill 
5,550-5,636 

30 

153 

216 

466 

812 

3,775-3,950 

Aldine 
4,436-4,786 

79 

118 

206 

618 

946 

2,500-2,800 

Jones 
4,532 

76 

200 

255 

569 

795 

2,636 

Table  V  should  be  read  as  follows:  The  Champion  speller, 
which  as  a  book  included  45.9  percent  of  the  3,105  words  of  the 
Anderson  list,  contained  24  percent  of  Part  I,  53  percent  of 
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TABLE  V.      PERCENT  OF  THE  ANDERSON  LIST  AND  OF  THE 
FIRST  FIVE  PARTS  CONTAINED  IN  EACH  SPELLER 

(Computed  from  Table  IV) 


Speller     with 

Percent  of 

Parti 

Partn 

Part  III 

Part  IV 

PartV 

Anderson 

(79  words) 

(213  words) 

(303  words) 

(849  words) 

(1,661  words) 

List  Included 

Champion 

45.9 

24 

53 

60 

53 

40 

Peirce 

25.2 

10 

24 

29 

30 

23 

Merrill 

54.0 

38 

73 

71 

55 

49 

Aldine 

63.9 

100 

55 

68 

73 

58 

Jones 

61.3 

96 

94 

84 

67 

48 

TABLE  VI.   SCORES  WHEN  THE  PERCENTS  OF  OVERLAPPING  GIVEN 

IN  TABLE  V  ARE  WEIGHTED  ACCORDING  TO  THE  NUMBER  OF 

DECILES  IN  EACH  PART 


Speller 

Parti 
(500) 

Part  II 
(200) 

Part  III 
(100) 

Partly 
(100) 

PartV 
(50) 

Total 
(950) 

/ 

2 

3 

4 

5 

6 

7 

Champion 

120 

106 

60 

53 

20 

359 

Peirce 

50 

48 

29 

30 

12 

169 

Merrill 

160 

146 

71 

55 

25 

457 

Aldine 

500 

110 

68 

73 

29 

780 

Jones 

480 

188 

84 

67 

24 

843 
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Part  II,  60  percent  of  Part  III,  53  percent  of  Part  IV  and  40  per- 
cent of  Part  V,  etc.  This  table  merely  serves  to  reemphasize 
the  superiority  of  the  Jones  and  Aldine  spellers  when  checked 
against  the  Anderson  list  of  commonly  used  words. 

To  give  a  more  complete  evaluation  of  the  books  on  the  basis 
of  their  selection  of  commonly  used  words,  the  parts  were  weighted 
according  to  the  number  of  deciles  or  the^part  of  a  decile  which 
the  words  therein  comprise.  Table  VI  showing  the  results  of 
such  weightings  is  derived  from  Table  V  by  multiplying  the  per- 
cents  for  Part  I  by  5,  i.e.,  the  number  of  deciles  in  that  part; 
the  percents  for  Part  II  by  2;  for  Part  III  by  1 ;  for  Part  IV  by  1 ; 
for  Part  V  by  3^.  By  this  system  of  weighting  the  perfect  scores 
for  Parts  I  to  V  respectively  are  500,  200,  100,  100,  and  50;  ard 
the  perfect  score  for  the  five  parts  taken  together  950. 

The  total  scores  as  given  in  column  7  show  that  the  spellers 
should  be  ranked  as  follows:  Jones,  first;  Aldine,  second;  Merrill, 
third;  Champion,  fourth;  Peirce,  fifth. 

It  should  be  pointed  out  that  even  though  the  Jones  speller 
is  given  first  rank  according  to  the  weighted  scores,  the  Aldine 
speller  has  a  higher  score  in  three  of  the  five  parts.  When  the 
books  were  ranked  according  to  the  percent  of  the  Anderson 
list  included  (Table  I),  the  Aldine  speller  excelled  the  Jones  by  a 
narrow  margin.  When  the  books  were  ranked  on  the  basis  of 
the  word  lists  for  grades  in  to  viii  inclusive  (Table  II)  the  Jones 
speller  excelled  by  seven-tenths  of  one  percent.  All  of  these  facts 
tend  to  show  that  little  difference  exists  between  these  two  spellers, 
and  that  superintendents  and  teachers  would  make  little  mistake 
in  choosing  either  book,  so  far  as  spelling  vocabulary  is  concerned. 

On  the  whole,  this  study  shows  a  great  range  in  the  size  of  the 
spelling  vocabulary — from  2,991  words  in  the  Peirce  speller  to 
6,270  words  in  the  Champion  speller.  It  also  shows  the  significant 
fact,  so  far  as  these  books  are  concerned  that  little  relation  exists 
between  mere  size  of  vocabulary  and  the  number  of  most  com- 
monly used  words  included.  For  example  the  Champion  speller 
with  6,270  words  contains  but  45.9  percent  of  the  Anderson  list 
while  the  Jones  speller  with  4,532  words  contains  61.3  percent 
of  the  list — which  fact  signifies  that  the  selection  of  a  spelling 
vocabulary  is  something  more  than  merely  collecting  so  many 
words.     The  study  also  shows  that  the  ratio  of  the  number  of 
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commonly  used  words  to  total  number  of  words  in  the  book 
varies  from  41.8  percent  in  the  Jones  speller  to  22 . 7  percent  in 
the  Champion  speller.  In  cold  facts  these  figures  mean,  if  we 
may  safely  argue  from  the  basis  of  the  Anderson  list,  that  from 
58  to  77  percent  of  the  time  devoted  to  spelling  within  the  public 
school  is  spent  upon  words  not  commonly  used.  Is  not  one  cause 
of  the  charge  sometimes  heard  today  that  children  are  not  efficient 
in  spelling  due  to  the  fact  that  we  leach  the  children  one  list  of  words 
in  the  school  room  and  the  world  expects  them  to  spell  another  list 
when  they  leave  the  school  room? 

The  study  shows  that  the  Jones  and  Aldine  spellers  rank  high, 
no  matter  whether  considering  the  number  or  percent  of  the 
Anderson  list  included,  the  ratio  of  the  words  of  the  Anderson 
list  to  the  total  number  of  words  in  the  book,  or  the  final  scores 
determined  through  the  adopted  system  of  weighting  the  words 
according  to  their  position  in  the  Anderson  list.  When  only  the 
vocabularies  intended  for  grades  iii  to  viii  inclusive  are  compared 
the  Merrill  speller  includes  a  higher  number  and  percent  of  the 
list,  but  this  speller  is  surpassed  by  the  previously  mentioned 
books  in  all  other  phases  considered. 

One  must  conclude  then  that  the  Jones  and  Aldine  spellers 
are  superior  to  the  other  three  spellers  under  consideration  as  far 
as  choice  of  vocabulary  is  concerned.  This  does  not  mean  that 
they  are  superior  in  other  respects,  nor  does  it  mean  that  they  are 
superior  to  other  spellers  on  the  market  today,  especially  thosd 
which  have  just  recently  come  from  the  press.  The  selection  of 
a  speller,  to  be  wholly  scientific,  should  take  account  of  all  spellers 
and  all  aspects  of  the  different  spellers;  but  this  was  impossible 
in  the  present  investigation.  Such  investigations  require  time 
and  energy;  but  it  can  safely  be  predicted  that  until  they  are 
made  we  shall  continue  to  select  books,  which  cause  children  to 
spend  their  time  upon  words  which  they  will  probably  never  use, 
and  we  shall  continue  to  select  books  incorporating  inferior 
methods.  Proper  utilization  of  scientific  method  in  the  selection 
of  spellers  or  other  textbooks  will  hasten  the  application  of  the 
best  established  psychological  principles  and  will  guarantee  prog- 
ress in  the  realization  of  the  social  point  of  view. 
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High  School  Visitor,  University  of  Illinois 

The  High  School  Conference  which  meets  annually  at  the 
University  of  Illinois  has  taken  as  its  definite  task  the  univer- 
salizing of  high  school  education  for  the  state.  Naturally  the 
carrying  out  of  such  a  project  calls  for  the  removal  of  numerous 
obstacles  and  the  making  of  important  readjustments.  These 
preliminary  steps  call  for  much  investigation  along  several 
different  lines  for  the  accompHshment  of  which  a  number  of 
committees  have  been  named.  These  committees  are  to  operate 
under  the  direction  of  a  central  committee  from  the  faculty  of 
the  College  of  Education  of  the  university. 

The  studies  for  which  committees  have  been  chosen  thus  far 
are  as  follows: 

L  Readjustments  needed  in  the  high  school  curriculum  and 
in  that  of  the  schools  leading  to  it. 

2.  Existing  conditions  in  the  state  for  the  training  of  teachers 
and  needed  extension  of  such  facilities. 

3.  Continuation  or  part-time  schools — where  needed,  of 
what  character,  and  how  they  are  to  be  provided. 

4.  The  possibilities  of  the  all-year  school — is  it  desirable 
and  practicable  for  Illinois. 

5.  Provisions  to  be  made,  other  than  those  now  existing,  for 
compulsory  attendance;  and  the  extent  to  which  there  may  be 
necessity  for  subsidizing  families  economically  incompetent  in 
order  to  keep  their  children  in  school. 

6.  The  need  of  extending  facilities  for  high-school  education 
through  the  organization  of  community  high  schools;  the  defining, 
of  an  economical  high  school,  and  the  problem  of  transportation 
of  pupils. 

At  the  last  session  of  the  conference  a  seventh  committee 
was  provided  for — a  committee  for  the  study  of  the  method 
of  readjusting  the  curriculum  as  it  affects  the  economics  of 
instruction  and  the  time  and  sequence  elements  of  the  problem. 

129 


130  JOURNAL  EDUCATIONAL  RESEARCH  Vol.  1,  No.  2 

It  seems  fitting  at  this  time  to  discuss  in  brief  detail  what  is 
involved  in  the  way  of  investigation  and  research  in  these  various 
committee  assignments.  Such  a  discussion  seems  all  the  more 
desirable  in  view  of  the  fact  that  some  of  those  interested  in 
the  movement  seem  not  to  be  able  to  visualize  the  entire  situa- 
tion with  sufficient  clearness  to  enable  them  to  see  the  neces- 
sities calling  for  such  an  extended  survey.  Let  us  take  the 
problems,  then,  in  the  order  named  above. 

The  demand  for  curriculum  readjustment  seems  to  be  uni- 
versal, and  just  now  there  is  apparently  a  tendency  to  get  at  the 
real  objectives  of  education  as  a  basis  for  such  readjustment. 
The  logical  order  seems  to  be:  the  determination  of  objectives, 
the  selection  and  arrangement  of  materials  and  processes  best 
calculated  to  become  effective  in  their  attainment,  and  the 
method  to  be  pursued  in  the  use  of  such  materials  and  processes. 
A  committee  of  the  N.  E.  A.  has  given  us  a  statement  of  objec- 
tives. But  the  presentation  by  the  chairman  of  our  conference 
committee,  Mr.  R.  L.  Sandwick,  seems  to  be  a  better  statement 
or  classification  ior  our  purposes. 

The  next  step,  the  selection  and  arrangement  of  subject 
matter  and  processes,  is  a  far  more  complicated  and  difficult 
problem.  We  have  been  going  on  from  the  very  beginning  of 
our  common  school  system  with  a  process  of  unorganized  accumu- 
lation of  materials,  both  new  and  traditional,  in  a  hopeless  jumble. 
Like  a  retail  dealer  of  dry  goods  and  notions  who  could  never 
manage  a  successful  "clearance"  sale  we  have  been  encumbering 
the  shelves  and  attic  of  our  educational  shop  with  old  and  out- 
of-date  stuff,  much  to  the  disadvantage  of  any  effective  "display" 
of  the  new.  Is  it  not  high  time  that  we  should  take  an  inventory 
of  the  "goods"  on  hand  with  reference  to  the  needs  of  our  "trade," 
arranging  them  in  the  most  advantageous  way  possible,  and 
disposing  of  all  non-essential  and  out-of-date  stuff  even  at  a 
sacrifice  if  necessary? 

Such  a  process  of  weighing  and  testing  will  require  much 
patient  work;  but  there  is  no  other  real  readjustment  to  be  had. 
We  shall  need  to  apply  mercilessly  the  tests  which  a  clear  under- 
standing of  our  educational  objectives  should  make  possible.  No 
might-have-beens  or  vague  possibilities  of  the  future  should 
lemain  to  mar  our  work.     It  is  evident,  then,  that  those  who 
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are  to  participate  in  the  testing  process  must  first  get  clearly 
in  mind  the  fundamental  objectives  of  school  education  as 
determined  by  life  needs.  It  will  be  necessary,  also,  that  a 
considerable  number  of  our  best  qualified  teachers  be  available 
for  service  in  this  educational  inventory. 

The  third  step  in  curriculum  reconstruction,  as  affecting  the 
economics  of  instruction  and  the  time  and  sequence  relations, 
must;  for  the  most  part,  wait  upon  the  progress  of  the  second 
step.  But  there  is  here  a  preliminary  work  to  be  done  which 
may  well  employ  the  attention  of  such  a  committee  until  such 
time  as  it  may  be  able  to  act  jointly  with  the  committee  on 
readjustment  of  content  of  the  curriculum.  This  prehminary 
study  by  a  committee  on  method  should  result  in  a  classification 
of  principles  of  general  method  together  with  an  attempt  to 
evaluate  them  on  a  basis  of  accomplishment.  In  making  such  a 
study  it  will  be  desirable  as  far  as  possible  to  avoid  mistaking 
the  special  application  of  a  principle,  at  a  given  time  or  under  a 
given  name,  for  an  entirely  new  principle  of  method. 

The  second  study,  that  of  teacher  training,  was  clearly  out- 
lined in  a  general  way  in  the  preliminary  report  of  the  committee 
last  November.  The  necessity  of  the  situation  was  made  very 
clear.  There  remains  to  be  made  now  a  careful  survey  for  the 
purpose  of  determining  the  number  and  character  of  teachers 
necessary  to  carry  through  successfully  any  plan  of  readjustment 
and  extension  of  high-school  education  that  may  result  from  the 
work  of  the  first  committee.  In  order  to  do  this  it  is  desirable,  as 
in  the  case  of  curriculum  reconstruction,  to  take  into  considera- 
tion the  needs  of  the  elementary  schools  as  well  as  of  the  high 
schools.  This  investigation  will  be  conducted  under  the  direc- 
tion of  Dr.  B.  R.  Buckingham,  acting  for  the  committee  of 
which  President  Felmley  is  chairman.  The  study  will  include 
not  only  the  sources  of  teacher  supply  but  also  their  distribu- 
tion, salary,  tenure  of  service,  and  preparation  for  their  work. 

The  third  committee  having  in  hand  the  problem  of  con- 
tinuation schools  is  now  facing  a  difficult  problem.  We  already 
have  a  law  on  the  statute  books  providing  for  the  progressive 
and  obligatory  establishment  of  such  schools  until  all  boys  and 
girls  of  ages  up  to  and  including  eighteen  are  in  attendance. 
But  we  do  not  know  where  or  what  kind  of  continuation  schools 
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are  needed;  we  have  not  enough  teachers  available  to  handle 
them;  we  do  not  know  how  the  law  is  to  be  enforced;  and  the 
problem  of  financing  such  an  extensive  addition  to  our  educa- 
tional system  has,  as  yet,  received  little  or  no  consideration. 
Moreover  we  have  not  yet  learned  how  we  are  to  motivate  the 
work  for  that  considerable  number  of  boys  and  girls  who  are  out 
of  school  simply  because  they  do  not  like  school  work  as  commonly 
organized,  especially  where  academic  subjects  are  concerned. 

It  seems  evident,  therefore,  that  there  is  much  for  this  com- 
mittee to  do,  and  that  it  should  be  done  as  promptly  as  possible, 
if  we  are  to  save  a  really  good  piece  of  legislation  from  disastrous 
failure.  The  saner  way  would  have  been  to  have  studied  the 
situation  first  and  then  to  have  sought  such  legislative  enactment 
as  would  fit  the  case. 

The  fourth  committee  has  a  similiar  though  newer  phase  of 
the  problem  to  consider — the  all-year  school  and  its  adaptability 
to  our  needs  in  Illinois.  First  of  all  such  a  committee  should 
ascertain  how  this  plan  is  working  where  it  ie  already  in  use. 
It  should  study  the  various  vocations  in  order  to  see  how  and 
where,  as  a  type  of  continuation  school,  it  will  best  serve  the 
interests  of  individuals  and  of  the  state.  It  is  possible  that  this 
t)^e  of  school  may  be  just  the  one  needed  for  children  of  the 
rural  districts  especially. 

Another  problem  closely  allied  to  the  third  and  fourth,  and 
one  which  may  well  be  handled  cooperatively  by  these  three 
committees,  is  the  problem  of  compulsory  attendance  and  of 
economically  incompetent  families,  as  assigned  to  committee 
number  five.  Here  again  methods  of  motivation  and  ways  and 
means  of  effectual  enforcement  of  law  must  be  seriously  con- 
sidered. This  study  should  include  a  thorough  investigation  of 
compulsory  attendance  laws  in  other  states,  the  manner  of  their 
enforcement  and  the  results  attained.  The  economic  problem 
involved  in  the  case  of  families  lacking  adequate  adult  workers 
as  bread  winners  needs  to  be  carefully  surveyed  and  the  most 
constructive  treatment  possible  provided. 

It  is  useless  to  consider  any  plan  for  universalizing  high-school 
education  without  providing  schools  sufficient  in  number  as  well 
as  in  character  to  take  care  of  all  classes  of  pupils  who  should 
attend.     To  this  end  the  sixth  committee  named  above  wa^ 
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provided.  Naturally  the  first  step  should  be  to  locate  the  sec- 
tions where  suitable  high-school  facilities  are  now  lacking  and  to 
determine  approximately  the  number  and  character  of  schools 
needed.  This  will  mean  a  careful  survey  of  the  state  for  the 
purpose  of  ascertaining  where  there  are  children  of  high-school 
age — fourteen  to  eighteen — for  whom  there  is  at  present  no 
suitable  high  school  available.  The  lack  may  be  due  either  to 
the  absence  of  any  school  near  enough  to  be  available  or  to  the 
lack  of  any  fitting  type  of  instruction  which  local  interests  or 
predominant  individual  inclination  seem  to  require. 

The  study  of  this  committee  also  involves  the  effort  to  deter- 
mine when  a  high-school  organization  is  economically  justifiable. 
This  would  imply  some  way  of  providing  for  a  possible  few  who 
would  otherwise  be  without  high-school  advantages.  Thus  the 
problem  of  transportation  of  pupils  living  at  a  distance  too  great 
for  walking  also  falls  to  this  committee. 

It  appears,  then,  that  a  very  complete  survey  of  the  situation 
is  proposed  and  already  in  progress.  Purposely  we  have  confined 
this  to  problems  purely  educational.  The  great  problem  of 
financing  education  is  left  for  some  one  to  take  up  as  a  separate 
study.  But  even  such  a  separate  study  must,  in  some  measure, 
be  able  to  take  into  consideration  many  if  not  all  of  the  results 
to  come  from  the  work  we  have  outlined  for  our  six  committees. 
Certain  it  is  that  the  time  has  come  for  all  of  us  to  consider  our 
educational  needs  in  the  light  of  our  economical  limitations  as 
related  to  education.  We  must  insistently  demand  the  elimina- 
tion of  waste  of  materials,  waste  of  teaching  talent,  waste  of 
pupil  time,  waste  from  unsanitary  conditions  and  practices  and 
from  physical  defects  and  disease. 

Such  a  plan  of  reconstruction  our  present  situation  demands. 
To  dally  with  it,  to  halt  because  of  its  difficulties,  is  only  to 
postpone  it  to  a  later  day  and  to  make  the  task  more  difficult. 
It  is  a  task  whose  alternative  is  social  decadence.  With  all  of 
our  varied  studies,  therefore,  there  needs  to  be  a  constant  effort 
to  enlist  the  thought  and  the  intelligent  comprehension  not  only 
of  those  who  teach  but  of  all  leaders  of  thought  in  all  communities 
of  the  state. 

One  of  the  most  gratifying  elements  of  the  above  program  is 
to  be  seen  in  the  fact  that  any  significant  progress  made  along 
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the  lines  outlined  will  bring  its  own  reward.  The  schools  will 
profit  by  any  advance  made  if  only  by  one  of  the  committees,  for 
all  these  committee  problems  stand  for  real  needs  in  our  educa- 
tional system.  So  whether  we  attain  our  objective  fully  or  not 
we  shall,  in  a  measure,  succeed.  But  if  we  believe,  with  all  our 
hearts,  in  a  new  and  better  Americanism,  we  shall,  by  persisting, 
attain  the  larger  goal. 


PSYCHOLOGY  OF  THE  EDUCATIONAL  "STANDPATTER" 

Some  are  educational  "standpatters"  because  they  have  never 
done  any  thinking,  others  because  they  are  held  captive  by  the 
thinking  they  once  did.  We  are  here  concerned  only  with  the 
latter.  Sometimes  he  is  a  scholar  in  academic  lines  but  has 
reached  his  saturation  point.  The  mind  has  crystalUzed  pre- 
maturely. A  negativistic  attitude  toward  the  new  is  one  of  the 
symptoms.  Such  an  individual  becomes  hypercritical  toward 
his  contemporaries.  He  considers  their  work  either  as  cheap 
and  shoddy  or  else  as  nothing  but  an  amplification  of  something 
from  one  of  the  favorite  authors  of  his  youth.  The  pose  of  dis- 
dainful superiority  is  cultivated.  He  cuts  himself  off  from  his 
fellow  workers  and  develops  the  shut-in  personality. 

One  wonders  whether  such  persons,  notwithstanding  the 
scholarly  attainments  which  they  sometimes  possess,  have  not 
after  all  a  fundamental  intellectual  defect.  Perhaps  it  is  a  lack 
of  constructive  imagination  that  robs  them  of  open-mindedness. 
Their  thinking  seems  to  have  no  anticipatory  reference.  They 
are  unable  to  see  how  things  point.  They  can  not  see  the  new 
day  that  is  dawning  in  education  because  their  intellectual  heads 
have  been  set  on  backwards. 

What  a  relief  to  turn  to  the  educational  worker  who  instead  of 
specializing  on  the  destruction  of  the  new,  just  because  it  is  new, 
has  a  never  failing  sense  for  the  importance  of  a  novel  contribu- 
tion, even  if  it  is  imperfect  or  in  part  erroneous.  Instead  of 
wasting  his  energies  in  the  attempt  to  overthrow  a  reading  test 
or  a  handwriting  scale  or  a  scale  for  grading  English  compositions 
he  tries  to  develop  something  better.  While  others  are  pro- 
claiming that  intelligence  is  too  complex  to  be  measured,  h^ 
devises  an  instrument  to  measure  it.  While  others  are  proving 
the  impossibility  of  scientific  vocational  selection  he  devises  and 

135 


136  JOURNAL  EDUCATIONAL  RESEARCH  Vol.  1,  No.  2 

Standardizes  a  trade  test  that  works.  Another  in  the  field  of 
school  administration  surveys  his  own  school  and  remodels  his 
curriculum  and  methods  in  the  Hght  of  the  results,  while  neighbor- 
ing superintendents  and  principals  are  inveighing  against  the 
pretensions  of  measurement  enthusiasts. 

This  is  not  a  plea  in  behalf  of  educational  science.  That  is  on 
its  way  and  will  not  be  turned  back.  It  is  rather  a  plea  to  the 
young  men  in  education,  whether  in  the  academic  or  the  practical 
field,  to  direct  their  talents  along  profitable  Unes.  It  would  also 
point  out  the  reflex  effects  upon  the  worker  of  the  lend-a-hand 
attitude,  as  contrasted  with  the  attitude  of  purely  destructive 
criticism.  The  one  attitude  favors  prolonged  intellectual  plas- 
ticity, the  other  brings  premature  hardening  of  the  intellectual 
arteries.  The  one  means  professional  growth,  the  other  pro- 
fessional death,  not  less  sure  because  it  may  be  insidious  and  slow. 

L.  M.  T. 

THE  VALUE  OF  STANDARDIZED  SILENT  READING  TESTS 

The  average  silent  reading  rate  of  eighth  grade  pupils  is 
approximately  240  words  per  minute  for  continuous  material. 
Scientific  investigation  is  revealing  that  this  rate  may  be  greatly 
increased  by  the  application  of  appropriate  methods.  On  the 
basis  of  data  already  secured,  it  is  conservative  to  say  that  this 
rate  could  be  increased  25  percent.  As  a  matter  of  fact,  it  is 
even  conservative  to  say  that  it  could  be  increased  50  percent. 

Silent  reading  is  used  as  a  tool  in  practically  all  subjects  studied 
in  the  high  school  or  in  college.  The  pupil  who  is  equipped  to 
read  at  the  rate  of  300  words  per  minute  has  a  decided  advantage 
over  the  pupil  who  is  equipped  to  read  only  240  words  per  minute. 
It  means  that  the  pupil  who  reads  more  slowly  either  must  spend 
more  hours  upon  his  work  or  do  less  work. 

Of  two  pupils  who  spend  an  equal  number  of  hours  upon  their 
work  in  high  school,  the  one  who  reads  at  the  rate  of  300  words 
per  minute  will  accompUsh  one-fourth  more  than  the  pupil  who 
reads  at  the  rate  of  240  words  per  minute.  This  will  mean  that 
in  the  course  of  four  years  this  pupil  will  do  25  percent  more 
work,  which  approximates  the  equivalent  of  an  extra  year  of 
schooling. 
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The  data  which  we  have  at  hand  not  only  shows  that  the 
rate  may  be  increased,  but  also  that  the  degree  of  comprehension 
can  be  materially  increased,  perhaps  to  an  equal  extent.  There- 
fore, not  only  may  pupils  be  trained  to  read  more  rapidly  but  at 
the  same  time  they  may  be  trained  to  read  with  increased  under- 
standing. Thus,  the  pupil  who  has  been  trained  to  read  at  the 
rate  of  300  words  per  minute  not  only  will  gain  an  extra  year's 
schooling  during  his  high-school  course,  but  if  his  training  has 
been  of  the  right  sort,  he  will  actually  do  a  better  quaUty  of  work. 

It  appears  that  the  use  of  a  standardized  test  for  measuring 
the  rate  and  comprehension  of  pupils  is  one  method  by  which 
the  rate  of  silent  reading  and  the  degree  of  comprehension  may 
be  materially  increased.  At  least,  where  such  tests  have  been 
used  and  the  results  properly  interpreted,  these  dimensions  of 
silent  reading  ability  have  been  increased.  Therefore,  it  is  not 
idle  to  say  that  by  using  standardized  silent  reading  tests  systema- 
tically, it  will  be  possible  to  increase  the  amount  of  education 
received  by  pupils  completing  the  high  school  by  25  percent. 
In  fact,  as  we  have  already  suggested,  such  a  prediction  is  con- 
servative in  view  of  the  facts  at  hand. 

The  fundamental  resources  of  a  state  are  vested  in  the  abilities 
of  its  citizens.  To  develop  these  abilities  is  to  enrich  society. 
The  increased  wealth  which  may  accrue  to  the  nation  from  the 
effective  use  of  standardized  tests  of  silent  reading  may  be  com- 
pared with  the  abundance  that  has  already  resulted  from  improved 
methods  in  science. 

W.  S.  M. 

RESEARCH  AND  THE  PROBLEMS  OF  EDUCATIONAL 
READJUSTMENT 

The  decade  preceding  the  World  War  was  educationally 
notable  for  the  advances  it  brought  along  material  lines  and  the 
external  aspects  of  school  administration.  Large  sums  were 
expended  for  school  buildings,  equipment,  and  playgrounds. 
New  types  of  schools  to  meet  new  needs  were  created  in  large 
number.  The  profession  of  school  administration  was  born  and 
brought  safely  through  the  ills  and  dangers  which  always  Ue  in 
wait  for  an  infant  profession. 


138  JOURNAL  EDUCATIONAL  RESEARCH  Vol.  1,  No.  2 

But  the  war  has  done  three  things:  (1)  it  has  left  the  schools 
financially  embarrassed  and  has  checked,  for  the  time  being, 
material  progress;  (2)  it  has  ruthlessly  exposed  our  educational 
failures;  (3)  it  has  given  us  a  host  of  new  educational  problems. 

History  shows  that  when  poverty-stricken  schools  face  insis- 
tent demands  for  higher  efficiency  the  result  is  likely  to  be  a 
development  along  the  lines  of  inner  organization,  method  and 
procedure.  This  occured  after  the  Civil  War;  it  will  occur  again. 
A  new  educational  era  is  upon  us.  Not  for  fifty  years  have  the 
problems  of  education  been  as  fluid  as  they  are  today.  It  is  a 
time  for  conscious  self-searching  and  for  conscious  decision  as  to 
the  attitude  one  will  take  toward  the  new  problems  of  educational 
readjustment. 

The  period  following  the  Civil  War  marked  a  renaissance  of 
interest  in  educational  method  based  upon  philosophy  and 
speculative  psychology.  Waves  of  Hegelianism  and  Herbartian- 
ism  swept  over  the  country.  Rousseau,  Pestalozzi,  and  Froebel 
were  studied  and  debated.  In  the  period  which  has  recently 
begun  questions  of  educational  procedure  are  again  coming  to  the 
fore,  but  with  the  difference  that  we  are  now  seeking  our  solutions 
by  the  methods  of  science  rather  than  by  an  appeal  to  arm-chair 
psychology.  Everywhere  tradition  is  being  challenged  by  experi- 
ment. No  method  or  program  is  sacred  enough  to  escape  the 
inquisitive  and  ubiquitous  pedagogical  test  or  scale.  By  means 
of  intelligence  scales  the  material  with  which  the  school  works  is 
subjected  to  the  same  cold  analysis  as  the  products  of  farm, 
factory,  or  mine.  Nothing  is  taken  for  granted;  everything  must 
be  proved.     The  spirit  of  educational  research  rules  the  day. 

That  much  of  this  scientific  endeavor  will  be  ill  directed  or 
misapplied,  and  that  much  which  is  well  directed  will  prove  abor- 
tive because  of  the  complexities  of  the  problems,  goes  without 
saying.  We  may  find  that  the  conclusions  of  science  no  more 
than  the  conclusions  of  the  a  priori  theorist  can  safely  be  accepted 
with  the  eyes  shut.  There  may  even  arise  a  new  type  of  pedant 
who  will  be  entirely  unable  to  think  educationally  except  in  terms 
of  zero  points,  frequency  curves,  probable  errors  and  mean  square 
deviations ! 

Nevertheless  educational  research  has  come  to  stay.  The 
only  escape  from  the  errors  of  scientific  method  is  by  a  more 
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careful  and  sagacious  use  of  that  same  method.  The  best  cure  for 
the  scientific  pedant  will  be  such  a  development  of  his  methods 
as  will  show  finally  where  the  boundaries  lie  beyond  which  those 
methods  are  not  for  the  present  applicable.  There  is  little  danger 
that  opponents  of  the  scientific  movement  in  education  will  be 
able  seriously  to  retard  its  progress.  There  is  every  likelihood 
that  such  opponents  of  the  inevitable  will  lose  whatever  oppor- 
tunities they  might  have  had  to  shape  the  course  of  modern 
educational  currents. 

L.  M.  T. 

MENTAL  AND  PHYSICAL  AGE  IN  RELATION  TO 
SCHOOL  ADMINISTRATION 

Compulsory  education  laws  are  driving  thousands  of  children 
to  the  schools  who,  under  former  conditions,  would  not  have 
attended.  The  statutes  make  no  distinctions  except, those  based 
upon  chronological  age  and  "physical  or  mental  disability." 
It  is  assumed  that  when  a  child  is  six  years  of  age,  he  is  ready  to 
enter  the  first  grade.  Many  children  are  ready  before  their 
sixth  birthday,  many  others  will  not  be  ready  until  later,  and  still 
others  will  never  be  ready  at  all.  If  we  are  going  to  speak  in 
terms  of  age,  let  us  use  the  ages  which  really  apply.  When  we 
say  that  a  six-year-old  child  is  ready  for  school,  we  at  once  get 
into  difficulties  because  of  the  wide  range  of  both  the  physical 
and  mental  abiHties  of  such  children.  We  need  a  finer  adjust- 
ment than  chronological  age  provides.  Evidently  then,  for 
school  use  we  must  have  a  different  conception  of  age.  If  six 
years  is  the  standard  for  entrance,  we  must  define  it  as  six  years 
physically  and  six  years  mentally.  Thus  we  have  the  conception 
(1)  of  physical  or  anatomical  age  and  (2)  of  mental  age.  Both 
of  these  have  real  application  to  the  work  of  the  school  and  to  the 
competence  of  children  to  do  the  work. 

We  can  measure  physical  age  and  mental  age  with  surprising 
accuracy.  It  is  gradually  becoming  incumbent  upon  the  school 
to  do  this.  An  x-ray  photograph  of  the  wrist  bones  indicates 
clearly  their  degrees  of  ossification.  A  series  of  standard  photo- 
graphs each  representing  average  development  for  a  chronological 
age  will  permit  the  matching  of  each  child's  photograph  agains^ 
the  series  so  that  the  skeletal  development  of  a  child  may  bg 
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determined  in  terms  of  years.  This  skeletal  development  is  a 
reliable  index  of  physical  maturity.  Almost  as  good  an  index  of 
physical  maturity,  however,  may  be  obtained  from  an  examination 
of  a  child's  teeth.  Since  permanent  teeth  should  normally  appear 
in  a  fixed  order  and  at  relatively  fixed  chronological  ages,  the 
number  and  character  of  these  teeth  furnish  a  reasonably  accurate 
measure  of  physical  maturity.  Anyone  can  apply  this  method,  for 
the  teeth  are  obviously  either  present  or  absent.  All  one  needs 
in  interpreting  the  results  of  the  count  is  a  table  indicating  the 
ages  at  which  the  teeth  appear  in  the  child  whose  anatomical  or 
physical  development  is  normal. 

Evidence  shows  that  anatomical  age  corresponds  much  more 
closely  to  mental  age  than  does  chronological  age.  But  although 
anatomical  age  is  a  much  safer  criterion  than  chronological  age 
as  a  basis  of  school  procedure,  it  is  insufficient.  In  all  cases  it 
must  be  supplemented  by  a  knowledge  of  mental  age.  After  all, 
a  child's  success  in  school  depends  primarily  upon  his  intelligence. 
The  means  of  measuring  intelligence  are  multiplying.  The  most 
brilliant  constructive  achievement  of  psychology  and  the  most 
useful  of  its  many  gifts  to  education  has  been  the  Binet-Simon 
Intelligence  Scale.  This  scale  reveals  in  terms  of  age  the  men- 
tality of  children.  It  is  a  "wonderful  instrument"  although 
critics  are  agreed  that  its  usefulness  in  measuring  intelligence 
beyond  that  of  the  normal  child  of  thirteen  or  fourteen  is  relatively 
less  than  it  is  for  lower  degrees  of  intelligence. 

We  are  now,  however,  on  the  eve  of  another  important  applica- 
tion of  psychology  to  education.  The  Binet-Simon  Scale  showed 
the  possibilities  of  mental  measurement  in  the  schools.  It 
remained,  however,  for  the  psychologists  to  devise  a  means  of 
mental  measurement  which  could  be  applied  quickly,  cheaply, 
and  without  the  services  of  a  specially  trained  examiner.  Such 
means  of  measurement  are  now  available.  Some  of  them  are 
being  commercially  distributed.  The  validity  of  these  "group 
tests" — the  extent  to  which  they  really  measure  intelligence — 
and  their  reHability  must  be  more  fully  estabHshed.  But  their 
usefulness  is  now  beyond  question.  They  are  not  substitutes  for 
individual  tests.  They  give  a  reasonably  accurate  general  impres- 
sion. Pupils  showing  extreme  scores  should  be  given  the  Binet 
test. 
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With  knowledge  of  the  mental  ages  of  children  supplemented 
by  knowledge  of  their  anatomical  or  physical  ages,  we  shall  be 
better  able  to  adjust  the  work  of  the  school  to  that  wide-ranging 
human  variability  which  is  everywhere  present  and  which  we 
cover  with  the  term  "individual  differences." 

We  are  confronted  with  the  necessity  for  training  large  masses 
of  pupils.  Perforce  we  must  organize  them  into  classes.  The 
real  task  of  the  modern  school,  therefore,  is  to  reach  the  individual 
through  the  group.  This  can  only  be  done  on  the  basis  of  a 
grouping  according  to  the  things  which  really  determine  success 
in  school  work. 

Boards  of  education  should  provide  for  a  survey  of  at  least 
the  mental  levels  of  all  ihe  children  in  the  schools  which  they 
control.  About  twenty  percent  of  the  children  should  receive 
special  education  of  some  kind.  The  intelligence  of  about  ten 
percent  is  so  far  below  normal  that  their  training  must 
consist  of  activities  which  call  for  relatively  little  mental  ability. 
Reading,  writing,  spelling,  and  arithmetic,  although  they  are 
subjects  ignorance  of  which  is  a  misfortune,  are  also  subjects 
which  children  of  certain  intellectual  levels  can  never  learn.  If  a 
child's  mental  age  is  only  half  of  his  chronological  age,  he  has  an 
intelligence  quotient  of  50.  This  will  remain  relatively  fixed. 
Such  a  child  will  never  become  much  more  than  eight  years  old 
mentally.  He  cannot  learn  arithmetic  or  even  enough  reading 
and  writing  to  do  him  any  good.  If  his  intelligence  quotient  is 
70,  we  may  teach  him  some  reading  and  writing,  but  it  will  be 
useless  to  try  to  teach  him  more  in  arithmetic  than  the  fundamen- 
tal operations  and  very  simple  notions  of  fractions.  Children 
of  intelligence  quotients  of  70  or  80  sometimes  reach  the  high 
school.  They  take  up  Latin  and  algebra  although  they  never 
succeed  in  these  subjects.  Indeed,  we  know  that  the  high  school 
as  it  is  at  present  organized  affords  no  place  for  children  of  such 
a  degree  of  mentality. 

There  are,  however,  a  vast  number  of  children  whose  intelli- 
gence is  below  normal  but  not  very  seriously  so.  While  these 
children  can  profit  by  the  teaching  of  the  common  branches  in 
their  more  elementary  form,  they  should  be  given  considerable 
industrial  training  for  they  will  recruit  the  ranks  of  unskilled  and 
semi-skilled  labor.     We  need  not  suppose  that  they  will  be  either 
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economically  incompetent  or  unhappy.  An  increasing  amount  of 
the  work  of  the  world  is  being  done  by  them;  and  their  rewards — 
at  least  in  wages — are  already  large,  and  they  are  increasing. 

Accordingly,  the  task  of  the  school  is,  first,  to  identify  those 
whose  lot  it  will  be  to  serve  in  these  capacities  and,  second,  to 
give  them  such  intellectual  training  as  they  can  use  and  such 
vocational  training  as  will  fit  them  to  perform  competently  the 
sort  of  work  they  will  be  called  upon  to  do.  The  kinds  of  manual 
work  best  suited  to  each  mental  age  has  now  been  worked  out  in 
considerable  detail.  A  woman  of  the  mental  age  of  seven  may 
be  taught  to  do  well  certain  forms  of  housework,  plain  sewing, 
rug  weaving,  lace  making,  and  a  number  of  other  occupations. 
A  man  of  the  same  age  may  do  good  housework  or  laundry  work, 
may  do  "outside  work"  or  teaming,  brush  making,  and  bench 
work.  In  fact,  the  number  of  possible  occupations  for  such  men 
is  rather  large.  Semi-skilled  labor  such  as  some  employees  in 
stores,  policemen,  firemen,  car  men,  and  some  of  the  lower  forms 
of  clerical  work  may  be  and  indeed  should  be  done  by  persons 
possessing  an  intelligence  inferior  to  normal,  or  at  least  not  higher 
than  normal. 

At  the  other  end  of  the  scale  of  intelligence  there  are  some 
eight  or  ten  percent  of  the  children  whose  gifts  are  so  superior 
that  they  should  not  be  subjected  to  the  school  training  which  is 
now  supposed  to  be  adjusted  to  the  abilities  of  the  normal  child. 
Since,  in  the  case  of  the  superior  child  intellectual  ability  is  pre- 
dominant, he  can  negotiate  the  regular  course  of  study  in  less 
time  than  can  the  normal  child;  for  the  regular  course  of  study  is 
essentially  intellectual  in  its  appeal.  Many  children,  capable  of 
completing  the  elementary  school  in  from  four  to  six  years,  are 
being  unfairly  treated  and  permitted  to  fall  into  loose  habits  of 
study  by  being  required  to  spend  eight  years  in  the  elementary 
school. 

Not  only  should  the  gifted  child  progress  more  rapidly  than 
the  normal  child,  but  his  work  should  differ  also  in  quality  and 
method.  Additional  problems,  more  significant  relationships, 
supplementary  assignments,  collateral  readings — all  the  types 
of  activities  which  we  would  like  to  carry  on  in  the  schools  but 
for  which  the  "minimum  essentials"  permit  so  little  time — these 
should  be  prominent  in  the  training  of  gifted  children. 
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Yet  special  provision  for  gifted  children  is  almost  non-existent. 
Without  the  aid  of  intelligence  tests  the  gifted  child  is  much  less 
frequently  identified  than  the  dull  or  defective  child.  Superior 
children  do  not  call  attention  to  themselves;  they  may  occupy 
moments  of  enforced  idleness  in  ways  of  their  own  choosing,  but 
they  are  successful  in  their  work.  With  a  truly  human  propensity 
they  adjust  their  effort  to  the  requirements  and  no  one  may  dis- 
cover that  they  are  capable  of  better  things.  This  is  part  of  the 
reason  why  we  are  regaled  with  stories  of  what  dullards  some 
eminent  men  were  in  their  school  days.  If  Byron  and  Goldsmith, 
Darwin  and  Gray  were  unappreciated  by  their  teachers,  we  may 
be  quite  sure  it  was  the  fault  of  the  teachers  and  of  their  means 
of  appraisal. 

The  psychologist  and  the  teacher  are  getting  together  on  this 
question.  The  psychologist  has  simplified  his  methods  of  testing 
and  he  is  training  the  teacher  to  use  the  simpler  instruments. 
On  the  other  hand,  school  people  are  realizing  with  conviction 
that  they  need  to  know  and  to  know  in  terms  of  the  new  methods 
of  measurement,  the  physical  and  mental  development  of  the 
children  entrusted  to  their  care.  No  educational  movement 
which  goes  to  make  up  the  modern  trend  of  educational  thought 
and  practice  promises  more  for  the  good  of  the  children  than  does 
the  movement  which  calls  for  the  physical  and  mental  measure- 
ment of  school  children  and  the  adjustment  of  school  procedure 
in  accordance  with  the  facts  as  revealed  by  these  measurements. 

B.  R.  B. 


Terman,  Lewis  M.    The  intelligence  of  school  children.     Boston:   Houghton 
Mifflin    Company,  1919.    317  pp. 

This  book  is  written  by  an  expert  for  the  use  of  practical  people.  The 
number  of  such  books  is  increasing.  There  is  a  cycle  through  which  a  move- 
ment passes.  The  idea  begins  by  engaging  the  attention  of  a  specialist  to 
whom  its  implications  may  at  first  be  but  vaguely  apparent.  If  he  is  a 
university  man,  he  perhaps  interests  a  few  graduate  students  in  his  idea  and 
writes  some  more  or  less  technical  articles  about  it — articles  which  practical 
people  cannot  read  and  which  they  are  inclined  to  belittle.  As  the  idea 
progresses  through  this  stage  of  its  development,  it  may  begin  to  attract 
wider  attention,  to  enlist  workers  in  new  centers,  and  to  reveal  some  of  its 
applications.  Thus  it  comes  to  have  a  practical  meaning  and  begins  to  touch 
the  lives  of  a  large  number  of  people.  Finally,  the  expert  who  began  it  may 
give  it  a  broader,  finer,  and  truer  interpretation — an  interpretation  which  he 
who  runs  may  read  and  which  cannot  be  ignored  or  undervalued  by  practical 
people. 

So  it  is  with  the  intelligence  testing  of  school  children.  This  book  is 
written  as  the  preface  states  "primarily  for  the  grade  teacher."  Not  so 
long  ago  the  subject  was  engaging  no  attention  outside  of  the  psychological 
laboratory  and  a  few  institutions  for  the  feeble-minded.  The  announced  pur- 
pose of  the  book  is  "to  illustrate  the  large  individual  differences  in  original 
endowment  which  exist  among  school  children  and  to  show  the  practical 
bearing  of  these  differences  upon  the  everyday  problems  of  class-room 
management  and  school  administration." 

The  Binet-Simon  Scale,  which  Dr.  Terman  has  done  so  much  to  refine  and 
adapt  for  American  use,  is  the  chief  means  of  measuring  intelligence  recog- 
nized in  this  book.  Appropriately,  therefore,  a  brief  description  of  the  scale 
and  of  the  derivative  measures  based  upon  it  is  given  in  the  beginning.  This 
is  followed  by  a  general  treatment  of  individual  differences  and  a  specific 
statement  of  their  amount  and  meaning  in  the  kindergarten,  in  the  first  and 
fifth  grades,  and  in  the  first  year  of  the  high  school. 

It  appears  that  a  large  proportion  of  kindergarten  children  could  do 
satisfactory  work  in  the  first  grade.  But  advancement  to  the  first  grade 
depends  upon  chronological  age — upon  living  six  years.  As  the  author  says, 
"the  most  abrupt  break  in  the  curriculum  is  that  from  the  kindergarten  to  the 
first  grade."     Nowhere  else  from  the  first  grade  to  the  university  does 
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advancement  depend  so  exclusively  upon  age.  "The  kindergarten  alone 
holds  aloof,  worships  at  the  shrine  of  a  special  methodological  cult,  and  treats 
its  children  as  belonging  to  a  different  order  of  human  beings."  The  need  for 
inteUigence  testing  in  the  kindergarten  and  of  action  based  on  the  results  is, 
therefore,  especially  evident. 

Two  first-grade  classes,  reported  by  the  author,  differed  in  average 
mental  age  by  more  than  two  years.  Yet  the  teachers  of  these  classes  were 
expected  to  accomplish  the  same  work.  The  teacher  of  the  poorer  class  was 
in  despair  and  her  efficiency  was  doubted.  But  there  was  nothing  wrong 
with  the  teacher.  Her  task  was  simply  impossible.  Differences  between  the 
mental  ages  of  pupils  in  the  same  grade  are  even  greater  for  higher  than  for 
lower  grades. 

As  to  high-school  conditions,  children  are  found  to  be  unlikely  to  graduate 
if  their  mental  ages  are  less  than  0.9  of  their  chronological  ages — in  other 
words,  if  their  intelligence  quotients  are  below  90.  Since  "nearly  a  third  of 
all  children  test  this  low  or  lower,"  the  author  declares  that  "high  schools  at 
present  are  in  a  measure  'class'  schools." 

Mental  age  is  offered  as  a  standard  for  grading.  It  is  shown  that  if  a 
child's  mental  age  corresponds  to  the  normal  age  for  his  grade,  he  will  do 
average  work.  Incorrect  grading  is  everywhere  apparent.  The  dull  child  is 
promoted  too  much  and  the  bright  child  too  little.  "The  typical  bright  child, 
though  already  under  age,  would  generally  continue  to  do  satisfactory  work 
if  promoted  one  or  two  grades." 

Dullness  is  incurable  and  brightness  persists.  The  intelligence  quotient 
(I.Q.)  is  the  measure  of  these,  and  it  remains  substantially  constant.  Be- 
tween the  first  and  second  of  428  pairs  of  I.Q.'s  the  correlation  coefficient 
was  +0.93.  Since  intelligence  practically  reaches  its  maximum  at  the  age  of 
16,  we  may  by  multiplying  16  by  the  I.Q.  predict  with  considerable  certainty 
what  a  child's  ultimate  mental  age  will  be.  Evidently,  therefore,  in  the 
inteUigence  quotient  we  have  a  basis  of  prediction  which  has  great  value  in 
educational  and  vocational  guidance.  It  will  not  tell  us  what  specific  studies 
or  occupations  a  child  should  pursue,  but  when  the  minimum  intelligence 
required  for  success  in  each  study  or  occupation  has  been  learned,  it  will  tell 
us  what  groups  of  subjects  a  pupil  may  attempt  and  in  what  types  of  work  he 
may  engage  with  the  probability  of  success.  Within  the  studies  or  occupa- 
tions appropriate  to  a  child's  mentality  choice  may  be  made  on  the  basis  of 
inclination  or  opportunity. 

Children  should  not  be  directed  into  occupations  for  which  they  have 
more  intelligence  than  is  of  use.  For  many  kinds  of  employment  the  intel- 
lectual demands  are  low,  yet  the  rewards  are  by  no  means  small.  Present 
industrial  developments  are  finding  a  larger  and  larger  use  for  persons  of 
inferior  mentality.  But  in  unskilled  and  semi-skilled  occupations,  intelligence 
above  a  certain  level  is  not  only  unnecessary  but  harmful.  Children,  there- 
fore, having  such  intelligence  should  be  directed  towards  the  higher  types 
of  vocations  for  which  they  are  fitted.  A  nation's  intellectual  assets  are 
priceless,  and  the  principle  of  conservation  will  here  have  its  most  far-reaching 
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application — an  application  in  which  the  teacher  occupies  the  strategic 
position. 

The  author  takes  the  attitude  that  unless  the  rank  and  file  of  teachers 
learn  to  use  intelligence  tests,  the  grading  of  children  according  to  ability 
"will  remain  largely  a  Utopian  dream."  He  advocates  the  introduction  in 
normal  schools  of  a  half-year  course  of  three  hours  per  week,  or  of  a  summer 
session  course,  to  prepare  teachers  for  Binet  testing.  He  believes,  however, 
that  teachers  in  service  may  learn  the  Binet  procedure,  and  in  the  last  chapter 
of  his  book  he  gives  helpful  directions  as  to  how  this  may  be  done.  While  the 
supervision  of  a  psychologist  or  of  a  person  experienced  in  the  use  and 
interpretation  of  the  tests  is  desirable,  it  is  believed  that  gross  errors  may  be 
avoided  without  such  assistance.  The  results  of  the  tests  will  never  make 
unnecessary  the  securing  of  supplementary  data  from  teachers  and  parents 
and  the  use  of  caution  and  common  sense.  Action,  especially  if  based  upon 
an  assumption  of  feeble-mindedness  or  dullness,  should  not  be  taken  until 
the  results  have  been  carefully  scrutinized  and  compared  with  data  as  to 
school  progress  and  attendance,  illness,  physical  defects,  occupation  and 
nationality  of  parents,  and  data  concerning  the  probable  mentality  of  other 
members  of  the  family. 

Ordinarily  it  takes  about  forty  minutes  to  test  a  child — somewhat  less  with 
primary  children,  somewhat  more  with  the  upper  grade  and  high-school 
children.  Where  time  does  not  permit  the  use  of  the  entire  scale,  the  author 
suggests  abbreviations  of  it.  He  also  recommends  the  use  of  some  of  the 
recently  devised  group  tests  which  can  be  given  simultaneously  to  an  inde- 
finitely large  number  of  children.  Group  tests  do  not  yield  as  dependable 
results  as  does  the  Binet  Scale.  They  should  be  followed  by  a  more  thorough 
examination  of  children  who  make  exceptional  scores.  Even  the  results  on 
the  Binet  test  are  not  to  be  taken  too  literally.  While  errors  are  relatively 
small,  one  must  remember  that  the  occasional  error  is  just  as  serious  for  the 
child  concerned  as  it  would  be  if  it  occurred  more  frequently.  Care  in 
interpreting  results,  re-testing  in  the  case  of  unusual  findings,  comparison 
with  the  results  of  educational  and  physical  tests,  with  teachers'  and  parents' 
estimates,  and  with  social  conditions  will  prevent  mistakes. 

To  us  the  most  fascinating  chapters  of  the  book  are  those  devoted  to  the 
special  study  of  a  selected  number  of  superior  children.  Facts,  some  of  which 
are  contrary  to  common  behef,  are  disclosed.  The  superior  child  is  not 
"queer,"  nor  physically  weak.  His  moral  qualities  are  likely  to  be  superior, 
and  his  mental  development  is  usually  general  rather  than  one-sided.  His 
superiority  is  shown  early  in  life  and  is  permanent.  Yet  he  is  usually  found 
in  a  school  grade  two  or  three  years  below  where  he  belongs  by  virtue  of  his 
ability. 

The  case  histories  of  forty-one  superior  children  are  given.  They  present 
a  vivid,  concrete  picture  of  what  the  superior  child  is  like.  Too  frequently 
they  show  how  utterly  these  children  are  misunderstood  and  uncojisciously 
thwarted  by  their  teachers. 

We  know  no  more  inspiring  reading  for  teachers  than  these  chapters  on 
superior  children.    They  dispel  old  notions  and  throw  light  upon  dark  places. 
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The  conviction  is  forced  home  that  such  children  may  actually  be  in  the 
reader's  class,  unrecognized  opportunities  for  a  type  of  service  which  every 
teacher  worthy  of  the  name  will  eagerly  seek. 

B.  R.  B. 

Pearl,  Norton  H.  AND  Brown,  H.  E.    Health  by  stunts.    New  York:  Mac- 

millan  Co.,  1919.     216  pp. 

This  little  book,  written  by  supervisors  of  physical  education  in  the 
Detroit  public  schools,  who  also  served  as  directors  of  athletic  activities  in 
the  army  training  camps,  and  with  the  A.  E.  F.  in  France,  will  be  welcomed, 
not  only  by  supervisors  and  teachers  of  physical  education,  but  by  parents, 
by  boys  and  girls,  and  by  all  who  are  interested  in  the  building  up  of  an 
American  manhood  and  womanhood  sound  in  body  as  well  as  in  mind.  The 
volume  gives  by  verbal  description  and  by  photographic  illustrations  direc- 
tions for  performing  a  series  of  graded  exercises,  or  better,  "stunts"  which  are 
in  effect  a  series  of  rough  standard  tests  of  physical  ability  and  condition. 
Research  men  will  be  interested  in  finding  many  illustrations  of  both  perform- 
ance tests  in  which  rate  of  accuracy  are  scored  directly,  and  of  ability  tests 
where  scores  are  determined  merely  by  success  or  failure.  Teachers  and 
supervisors  of  physical  education  will  value  highly  many  suggestions  in 
regard  to  methods  of  organizing  physical  education  work  in  the  schools,  of 
conducting  contests,  of  scoring  and  tabulating  results,  and  so  on,  but  the  chief 
interest  to  workers  in  educational  measurement  is  to  be  sought  in  the  many 
possibilities  the  book  reveals  for  the  construction  of  standardized  tests  of 
physical  abUity.  It  is  probable  that  those  responsible  for  physical  education 
in  our  schools  will  soon  feel  the  pressure  for  proof  of  results  which  the  public 
is  exerting  on  every  phase  of  public  education.  When  the  time  comes  for 
surveys  and  tests,  this  little  book  should  prove  a  rich  mine  of  test  material. 

For  instance,  in  Detroit,  the  contestants  to  qualify  for  the  Decathlon 
must  pass  a  series  of  preliminary  tests  administered  under  standard  condi- 
tions. He  must  be  an  eighth-grade  boy,  without  organic  weakness.  He 
must  be  able  to  chin  himself  six  times,  do  the  "set  up"  sixteen  times,  the 
"floor  dip"  ten  times,  have  a  grip  of  at  least  sixty  pounds  and  a  lung  capacity 
at  least  two  and  six-tenths  times  his  heighth  in  inches.  Why  should  there  not 
be  such  age-grade  standards  of  physical  fitness  all  along  the  line?  When  the 
product  of  all  physical  training  is  checked  against  suitable  objective  standards 
it  will  become  much  more  effective  than  it  has  in  the  past,  and  the  physical 
fitness  of  the  average  American  will  be  assured. 

S.  A.  C. 

BoBBiTT,  Frank  M.    The  curriculum.    Boston:  Houghton  Mifflin  Co.,  1918. 

295  pp. 

During  the  last  ten  years  increasing  attention  has  been  paid  to  the 
construction  of  curriculums  in  school  subjects,  particularly  in  the  fields  of 
spelling  and  language;  but  no  systematic  treatise  has  been  published  during 
that  time  until  the  appearance  of  Professor  Bobbitt's  book. 
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The  book  is  refreshing  in  its  beauty  and  simpUcity  of  style.  It  reads 
easily  and  speaks  directly  to  the  point  in  dealing  with  the  topics  under  dis- 
cussion. These  are  grouped  in  six  sections:  ends  and  processes,  training  for 
occupational  efl&ciency,  education  for  citizenship,  education  for  physical 
efl&ciency,  education  for  leisure  occupations,  and  education  for  social  inter- 
communications. 

In  the  first  section  the  groundwork  for  treatment  of  the  remaining  groups 
is  laid.  In  this  section  a  valuable  distinction  is  made  between  experience 
gained  by  undirected  study  on  the  play  level  and  that  obtained  by  directed 
study  on  the  work  level.  Of  particular  significance  is  the  author's  claim  that, 
after  experience  has  been  gained  without  direction  by  children,  the  curricu- 
lum that  follows  this  "aims  at  those  objectives  that  are  not  sufficiently  attained 
as  a  result  of  the  general  undirected  experience."  Or,  to  paraphrase,  after  a 
child  has  picked  up  what  he  will  by  himself,  the  school  should  discover  his 
shortcomings  and  correct  those.  Thus,  for  instance,  the  author  says,  in 
language,  the  school  curriculum  should  be  based  upon  the  language  errors  of 
children.  In  vocational  education  it  should  be  based  upon  occupational 
deficiencies. 

It  is  not  entirely  clear  in  my  mind  whether  undirected  experience  is  a  part 
of  the  curriculum  or  not.  The  author  does  not  discuss  the  point;  but  this  is 
probably  an  oversight.  Obviously,  it  is  not  practicable  to  let  children  pick 
up  experience  everywhere.  If  a  child  is  turned  into  a  library  to  browse,  it  is 
necessary  that  the  books  be  selected  upon  some  basis.  If  he  is  allowed  to  run 
at  large,  the  boundaries  must  be  set  in  some  way:  the  sawdust  of  a  saloon 
floor  ought  certainly  to  be  taboo  for  a  growing  boy.  And,  if  this  "undirected 
experience"  is  really  selected  and,  therefore,  part  of  the  curriculum,  errors  and 
shortcomings  will  hardly  constitute  an  adequate  basis  for  selection.  An  inter- 
esting argument,  at  least,  could  be  made  on  the  subject. 

It  is  unfortunate  that  the  author  does  not  show  the  applications  of  the 
shortcomings  concept  to  the  construction  of  directed  curriculums  in  citizen- 
ship, physical  education,  literature,  and  the  foreign  languages.  But  this  is 
probably  not  an  omission  because  the  text  is  a  "first  book"  and  deals  largely 
with  the  functions  of  the  activities  mentioned,  rather  than  with  the  content 
of  the  curriculum  necessary  for  the  realization  of  each. 

The  book  is  timely  and  will  be  of  fundamental  value  to  any  student  of  the 
curriculum. 

w.  w.  c. 
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A  BIBLIOGRAPHY  OF  STANDARDIZED  TESTS  FOR  THE 
HIGH  SCHOOLi 

Walter  S.  Monroe, 
Assistant  Director,  Bureau  of  Educational  Research,  University  of  Illinois 

In  addition  to  standardized  tests  designed  to  measure  the  abilities  of  pupils  in  high* 
school  subjects,  certain  tests  designed  for  use  in  the  elementary  school  have  been  given 
io  high-school  pupils.  In  assembling  this  bibliography  an  elementary  school  test  was 
included  if  a  published  report  of  its  use  in  high  school  was  found.  Doubtless  other 
elementary  school  tests  have  been  or  could  be  used  with  profit  in  the  high  school. 

A  special  effort  was  made  to  have  the  list  of  tests  designed  for  use  in  the  high 
school  include  all  of  which  an  account  had  been  published.  A  few  tests  have  been 
included  which  are  in  the  process  of  construction.  Although  it  may^  be  that  some 
tests  escap)ed  notice,  this  list  is  more  complete  than  any  which  has  been  previously 
published.  In  a  few  instances  it  was  diflScult  to  determine  whether  the  methods  used 
in  constructing  a  list  of  questions  or  exercises  were  suflBciently  scientific  to  justify  its 
inclusion  in  this  bibliography.  In  general,  doubtful  tests  were  included.  For  this 
teason  the  reader  is  cautioned  against  attaching  undue  importance  to  the  fact  that  a 
test  appears  in  this  list.  Before  a  test  is  selected  for  use,  careful  consideration  should 
be  given  to  both  the  method  of  its  derivation  and  the  results  of  its  use.  When  accounts 
of  these  are  lacking,  the  advice  of  competent  authorities  should  be  sought. 

The  list  of  references  for  a  test  includes  the  accoxmt  of  its  derivation,  if  it  has  been 
published,  and  the  more  important  accounts  of  its  use.  The  brief  annotation  indicates 
the  character  of  the  reference. 

The  publisher  from  which  a  test  can  be  obtained  is  given  when  it  could  be  ascer- 
tained. The  Bureau  of  Educational  Research  of  the  University  of  Illinois  carries  in 
stock  a  number  of  tests  which  are  published  elsewhere,  and  for  most  of  these  the  Bureau 
has  devised  class  record  sheets  or  other  accessories.  For  this  reason  the  Bureau  of 
Educational  Research,  as  well  as  the  original  publisher,  is  given  as  a  source  from  which 
Buch  tests  may  be  obtained.  A  few  of  the  tests  listed  are  not  available  for  distribution. 
In  these  cases  the  address  of  the  author  is  given  if  it  is  known.  All  prices  are  omitted 
because  the  unstability  of  the  printing  industry  prevents  announcing  them  perma- 
nently. 

Under  the  head  of  "General  References"  there  is  given  a  selected  bibliography 
which  deals  with  the  general  topic  of  educational  measurement.   Some  of  the  references 

1  This  bibliography  was  prepared  with  the  assistance  of  Miss  Margaret  Doherty,  Library  Assistant 
In  the  Bureau  of  Educational  Research,   University  of  Illinois. 
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pertain  to  tests  for  use  in  the  elementary  school,  but  they  will  also  be  found  helpful 
by  those  interested  in  the  high  school  field. 

A  section  is  devoted  to  mental  tests.  This  particular  field  is  developing  so  rapidly 
at  this  time  that  it  is  impossible  to  give  a  complete  list  of  the  tests  that  have  been 
devised  or  that  are  in  the  process  of  derivation.  For  this  reason  the  reader  must  regard 
this  particular  list  as  tentative  and  incomplete. 

General  References 

Chapman,  James  C.  and  Rush,  Grace  P.  The  scientific  measurement  of  classroom 
products.    New  York:  Silver,  Burdett  and  Co.,  1917. 

For  the  most  part  this  book  deals  with  tests  for  use  in  the  elementary  school.  There  are  three  general 
chapters  which  will  be  of  interest  to  high  school  teachers. 

Courtis,  Stuart  A.  The  Gary  public  schools:  measurement  of  classroom  products. 
New  York:  General  Education  Board,  1919. 

Besides  being  a  report  of  the  use  of  a  number  of  standardized  tests  in  the  Gary  public  schools,  includ- 
ing the  high  school,  this  volume  is  an  imjxjrtant  contribution  to  the  theory  of  educational  measurements. 
The  validity  and  reliability  of  the  tests  used  in  the  survey  are  treated. 

The  measurement  of  educational  products.  (The  Seventeenth  Yearbook  of  the 
National  Society  for  the  Study  of  Education,  Part  II).  Bloomington,  Illinois:  Public 
School  Publishing  Company,  1918. 

This  volume  of  the  Yearbook  is  a  compilation  by  members  of  the  National  Association  of  Directors  of 
Educational  Research.    A  complete  bibliography  is  given. 

Monroe,  Walter  S.  "Improvement  of  instruction  through  the  use  of  educational 
tests,"  Journal  of  Educational  Research,  1:96-102,  February,  1920. 

This  article  presents  a  procedure  for  interpreting  class  scores  and  distributions  with  special  reference 
to  the  Courtis  Standard  Research  Tests,  Series  B. 

Monroe,  Walter  S.  and  De  Voss,  J.  C.  and  Kelly,  F.  J.  Educational  tests  and 
measurements.     Boston:  Houghton  Mifflin  Co.,  1917. 

This  is  a  general  treatise  upon  educational  tests  and  their  use.  Chapter  vi{  is  devoted  to  high-school 
tests. 

Proctor,  W.  M.  "Psychological  tests  employed  in  the  vocational  guidance  of 
high  school  pupils."  (To  appear  in  the  first  volume  of  the  Journal  of  Educational 
Research.) 

Starch,  Daniel.     Educational  measurements.     New  York:  Macmillan,  1916, 
This  book  contains  two  chapters  upon  school  marks.    Most  of  the  tests  which  were  in  existence  at  the 
time  the  book  was  written  are  reproduced.   A  number  of  them  are  designed  for  high  school  subjects. 

Terman,  Lewis  M.  The  intelligence  of  school  children.  Boston:  Houghton  Mifllin 
Co.,  1919. 

This  book  emphasises  the  need  for  the  use  of  intelligence  tests  in  the  classification  and  guidance  of 
pupils. 

Terman,  Lewis  M.  Measurement  of  intelligence:  an  explanation  of  and  a  complete 
guide  for  the  use  of  the  Stanford  revision  and  extension  of  the  Binet-Simon  intelligence 
scale.     Boston:  Houghton  Mifflin  Co.,  1916. 
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I.  CoifUERCiAL  Subjects 

National  Business  Ability  Tests 

1.  Test  on  tabulation  (mental  alertness) 

2.  Reproducing  instructions 

3.  Test  on  invoicing 

4.  Tests  on  fundamental  arithmetic: 

a)  Fractions 

b)  Percentage 

5.  Test  in  business  arithmetic 

6.  Tests  in  English 

a)  Spelling,  elementary  and  advanced 

b)  Grammar  and  punctuation,  elementary  and  advanced 

7.  Elementary  test  in  letter  writing 

8.  Test  on  answering  letters  (advanced) 

9.  Stenographic  tests  (transcription  and  typewriter  copying) 

10.  Test  on  copying  for  the  mimeograph 

11.  Test  on  addressing  envelopes  with  a  pen  and  on  filing 

12.  Ayres'  Handwriting  Scale  used  to  judge  handwriting 

The  nature  of  the  above  tests  is  indicated  in  a  general  way  by  the  titles.  For  a 
detailed  description  consult  Chapter  v  of  the  reference. 

For  each  of  the  tests  there  are  "two  stries"  or  two  forms.  It  is  intended  that  the 
first  series  be  used  when  the  test  is  given  for  the  first  time  and  the  second  series  is  to  be 
used  when  it  is  desired  to  repeat  the  test.  The  two  series  arc  intended  to  be  equivalent 
in  di65culty. 

Publisher:  National  Associated  Schools  of  Scientific  Business,  Inc.,  Chicago. 
Reference:  Cody,  Sherwin.     Commercial  tests  and  how  to  use  them.     Yonkers-on-Hud- 

son.  New  York:  World  Book  Company,  1919. 

Part  One  contains  the  following  chapters:  Schools  and  business  employment,  National  Busisess 
Ability  Tests,  principle  of  scientific  tests,  national  tests  in  the  classroom. 

Part  Two  consists  of  the  following  chapters:  Two  series  of  National  Business  Ability  Tests  (tests  are 
reproduced,  with  directions  for  giving  and  scoring),  measuring  classes  and  teachers.  Appendix  is  devoted 
to  the  report  of  use  of  the  tests  in  classroom. 

Rogers'  Stenographic  Tests.  This  is  the  combination  of  tests  which  Mr.  Rogers  found 
to  be  useful  for  identifying  those  persons  who  possessed  the  qualities  necessary 
for  a  successful  stenographer: 

1.  For  dictation 

a)  Hard  Directions 

b)  Opposites 

c)  Form  Substitution 

2.  For  grammar 

a)  Hard  Directions 

b)  Opposites 

c)  Mixed  Relations 

3.  For  typewriting 

a)  Verb  Object 

b)  Color  Making 
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Reference:  Jaques,  M.  P.     "Mental  tests  for  typists  and  stenographers,"  Indus- 
trial Management,  58:145-46,  August,  1919. 

A  dlKussion  of  an  experiment  with  the  Rogers'  Stenographic  Tests  in  the  Brooklyn  branch  of 
the  Charles  Williams  Company. 

II.  Domestic  Science 

Bowman  and  Trilling  s  Informational  and  Reasoning  Teats  in  Textiles  and  Gothing. 

"These  tests  have  been  constructed  by  Leona  F.  Bowman  and  Mabel  Trilling  of 
the  University  of  Chicago  and  will  be  described  in  a  forthcoming  number  of 
Supplementary  Educational  Monographs  published  by  the  School  of  Education, 
University  of  Chicago." 

Murdock's  Scale  for  Measuring  Certain  Elements  in  Hand  Sewing. 

Publisher:  Bureau  of   Publications,   Teachers'    College,    Columbia   University, 
New  York  City. 

Williams  and  Knapp's  Scale  for  Measuring  Skill  in  Machine  Sewing.  The  method  of 
deriving  this  scale  is  similar  to  that  used  in  Thorndike's  Handwriting  Scale. 

III.  Drawing 

Manuel's  Suggested  Series  of  Tests  for  Studying  Talent  in  Drawing.  On  the  basis  of 
experimental  testing  of  nineteen  persons  who  had  marked  ability  in  drawing,  six  of 
whom  were  high-school  students.  Dr.  Manuel  suggests  the  following  set  of  diagnos- 
tic tests: 

1.  Tests  of  the  elementary  ability  to  represent  by  lines  and  areas,  figures  and  objects 

directly  observed.    Drawing  a  horse  (memory)  and  a  toy  wagon  (object). 

2.  Tests  of  general  intelligence  (Stanford-Binet  revision)  with  special  reference  to: 

a)  Memory  for  Digits 

b)  Designs 

c)  Sixty  Words 

d)  Clock  Test 

e)  Vocabulary 

f)  Fables 

g)  Code 

h)  Inclosed 

i)   Paper  Cutting 

j)  Logical  Memory 

3.  Tests  of  ability  to  discriminate  differences  in  visual  magnitudes  (Manuel's  Test 

in  Discrimination  of  Visual  Proportions,  Manuel's  Series). 

4.  Tests  of  visual  acuity  and  normality  of  color  vision. 

5.  Tests  of  ability  to  observe  visually: 

a)  Whipple  Cancellation  Tests — 4  forms 

b)  Rossolimo  Observation  Test 

c)  Whipple  Description  of  a  Stamp 

d)  McDougall  Spot  Pattern 

6.  Tests  of  memory  for  visual  forms  especially  deferred  memory: 

a)  Rossolimo  Recognition  of  Lineal  Figures 
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b)  Rossolimo  Recognition  of  Colored  Figures 

c)  Rossolimo  Recognition  of  Pictures 

7.  Tests  of  ability  to  manipulate  spatial  forms. 

a)  Thurstone's  Hand  Test 

b)  Thurstone's  Spatial  Relations  Test 

c)  Punched  Holes 

d)  Rugg's  Painted  Cube  Test 

8.  Tests  of  esthetic  judgment: 

a)  Thomdike's  Tests  of  Esthetic  Appreciation 

b)  University  of  Illinois — Esthetic  Judgment  Test. 

Reference:  Manuel,  H.  T.     Talent  in  drawing:  an  experimental  study  of  the  u$e 
use  of  tests  to  discover  special  ability.  (School  and  Home  Education  Mono- 
graphs No.  3).     Bloomington,  Illinois:  Public  School  Publishing  Company, 
1919. 
This  monograph  is  devoted  to  a  description  of  the  tests  and  an  analysis  of  the  results  obtained. 

Rugg's  Scale  for  Measuring  Freehand  Lettering  for  Use  in  Secondary  Schools  and 
Colleges.  It  consists  of  a  series  of  eight  samples  of  freehand  lettering,  arranged  in 
the  order  of  increasing  merit.  It  may  be  used  in  measuring  the  eflficiency  of  a 
student's  work  in  freehand  lettering. 

Reference:  Rugg,  H.  O.    "A  scale  for  measuring  freehand  lettering,"  Journal  of 
Educational  Psychology,  6:25-42,  January,  1915.  ^ 

Derivation,  function,  and  experience  with  the  scale  is  discussed. 
(To  be  continued  in  the  March  Number.) 


The  George  Peabody  Foundation  has  recently  sponsored  a  movement 
that  is  full  of  promise  for  the  future  cultural  and  educational  relations  of 
America  with  foreign  nations.  This  is  no  less  than  the 
International  effective  organization  of  all  correspondence  between 

Educational  pupils  studying  modern  foreign  languages  in  American 

Correspondence  schools  and  those  similarly  engaged  in  the  schools  of 

France,  of  Spain  and  South  America,  and  of  such  other 
lands  as  shall  eventually  be  included.  Hitherto  such  letter  exchange,  while 
of  great  value  in  individual  instances,  has  been  ephemeral,  spasmodic,  and 
disorganized.  It  has  not  realized  its  full  potentialities.  The  Peabody 
Foundation  has  set  aside  one  of  its  buildings  on  the  campus  of  the  Peabody 
College  for  Teachers  at  Nashville  as  the  national  American  ofl&ce  and  has 
appointed  Dr.  Alfred  I.  Roehm  as  national  director.  With  the  cooperation 
of  state  and  community  chairmen  all  over  the  country  the  work  of  inter- 
national educational  correspondence  is  rapidly  being  organized. 

The  first  branch  established  was  the  French-American  Bureau.  In 
France  Monsieur  Charles  Gamier  of  the  French  Ministry  of  Education  has 
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charge  of  the  central  French  ofl&ce  in  Paris.  Lists  of  pupils  in  French  and 
Belgian  schools,  who  have  been  selected  as  especially  fitted  to  inaugurate 
the  correspondence,  are  sent  to  the  American  office  at  Nashville  where  the 
details  of  exchange  with  American  schools  are  arranged.  A  similar  Bureau  to 
cover  correspondence  with  Spanish-speaking  lands  has  been  authorized  by 
the  United  States  Department  of  State,  and  this  will  be  organized  imme- 
diately. Other  bureaus  to  include  other  foreign  languages  will  follow  in  due 
course. 

The  plans  of  the  Peabody  Foundation  have  received  worldwide  approval. 
The  possibilities  of  liberalizing  influences  and  contacts  are  without  limit. 
To  quote  from  Mr.  Claxton's  article  in  School  Life  for  September  15,  1919: 
"Linguistic  training  will  not  be  the  only  educational  end  served.  Along 
with  the  letters  there  will  be  a  fine  exchange  of  historical,  artistic,  geographi- 
cal, manufactural,  commercial,  and  home-life  material  and  information 
clippings,  picture  postals,  kodak  views,  etc.,  leading  up  to  the  deepest 
exchanges  of  human  sympathies  and  ideals  that  will  reinforce  international, 
good-will."  In  addition  to  the  above  article  of  the  Commissioner  of  Educa- 
tion the  reader  is  referred  for  details  to  a  description  of  the  purposes  and 
plans  of  the  Foundation  in  The  Modern  Language  Journal  for  November, 
1919,  pages  7v^-76  by  the  present  writer.  Another  shorter  article  of  interest 
may  be  found  in  School  and  Society  for  September  27,  1919,  page  377.  It  is 
manifest  that  pupils  cannot  at  once  write  letters  of  very  great  value  in  the 
foreign  language.  Therefore  it  is  suggested  that  the  initial  letters  be  in  the 
pupil's  own  tongue.  Thus  each  school  will  gradually  have  a  number  of  model 
letters  in  the  foreign  idiom.  Careful  study  of  these  models  will  be  far  more 
stimulating  than  the  usual  arid  exercise  of  the  average  composition  manual. 
The  pleasure  of  actuality  is  here  of  great  value.  This  has  been  the  universal 
experience  of  teachers  who  have  tried  letter  exchange  in  lieu  of  set  composi- 
tion. In  due  course  the  pupil  will  substitute  the  foreign  tongue  for  his  own. 
Each  letter  received  is  a  challenge  to  send  in  return  an  equally  good,  or  a 
better,  answer.  It  is  of  course  deemed  wise  that  boys  shall  correspond  with 
boys,  and  girls  with  girls,  since  mutual  interests  are  thereby  better  utilized. 
While  the  burden  upon  the  teacher  will  doubtless  be  somewhat  greater  at 
first  than  under  the  usual  conditions  of  composition  work,  yet  the  same 
stimulus  exists  for  teacher  as  well  as  pupil.  It  is  even  quite  conceivable  that 
the  net  result  may  prove  a  lessening  of  the  teacher's  task  rather  than  an 
increase,  since  pupils  invariably  do  better  that  which  they  like  to  do.  At 
present  no  composition  manual  based  upon  epistolary  style  exists,  but  such 
books  will  soon  appear  in  response  to  an  evident  demand,  and  they  can 
greatly  help  in  this  important  work. 

It  is  the  aim  of  the  Peaboby  Foundation  to  establish  this  enterprise  upon 
a  self-supporting  basis  as  soon  as  possible.  Therefore  communities  and 
schools  are  asked  to  contribute  to  a  permanent  endowment  fund  in  one  of  two 
ways.  By  the  first  or  "quota  method"  each  community  will  pay  two  dollars 
for  each  one  thousand  inhabitants.  This  single  payment  will  entitle  all 
persons  in  the  community  to  all  services  of  the  Foundation  forever.  By  the 
second  or  "fee  method"  every  pupil  enrolled  for  international  correspon- 
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dence  will  pay  an  annual  fee  of  ten  cents.  Already  there  have  been  enroll- 
ments under  both  these  methods  from  every  state  in  the  Union,  and  the 
interest  is  rapidly  spreading.  Until  this  permanent  endowment  has  been 
secured,  the  Peabody  Foundation  will  bear  the  expense  of  the  enterprise. 
Later  it  will  be  the  trustee  of  the  endowment  and  will  render  annual  reports 
to  the  United  States  Bureau  of  Education. 

The  liberalizing  effects  of  such  a  system  of  international  correspondence 
are  certainly  beyond  all  doubt.  All  friends  of  education  see  in  this  plan  very 
great  possibilities  of  good  and  will  be  eager  to  contribute  to  its  success. 

Thomas  E.  Oliver 
State  Chairman  for  Illinois. 

The  tenth  annual  conference  of  specialists  in  industrial 
Manual  Arts  education  engaged  in  training  teachers  in  industrial  and 

Conference,  manual  arts  in  institutions  ocated  in  the  Mississippi  Valley 

University  of  was  held  at  the  University  of  Cincinnati,  December  fourth, 

Cincinnati  fifth  and  sixth,  1919.    About  forty-five  men  representing 

approximately  as  many  institutions  were  in  attendance. 

These  conferences  are  called  from  year  to  year  by  the  United  States 
Commissioner  of  Education  at  the  request  of  the  group,  there  being  no 
permanent  organization.  For  the  past  ten  years  Dr.  William  T.  Bawden, 
Assistant  to  the  Commissioner,  has  acted  for  the  Commissioner  in  the  matter 
arranging  time,  place,  and  program. 

The  following  papers  were  presented  at  the  Cincinnati  meeting.  The 
program  was  planned  to  allow  g«nerous  time  for  discussion  by  the  group. 
In  fact  the  meeting  is  looked  upon  primarily  as  an  opportunity  for  the  ex- 
change of  views  by  those  present. 

"An  experiment  in  developing  a  course  in  foreman  training"  by  Charles 
R.  Allen,  Agent  for  Industrial  Education,  Federal  Board  for  Vocational 
Education,  Washington,  D.  C. 

"Progress  in  the  development  of  plans  for  preparing  teachers  of  industrial 
subjects"  by  Professor  James  McKinney,  Director  of  the  Chicago  Center  of 
Teacher  Training  Department  of  Industrial  Education. 

"The  itinerant  teacher  of  subjects  in  village  and  rural  schools"  by 
Professor  C.  S.  Van  Deusen,  State  Normal  School,  Kent,  Ohio. 

"Provision  for  the  training  of  vocational  teachers  in  the  army"  by 
Professor  R.  W.  Selvidge,  Educational  Adviser,  War  Plans  Division,  War 
Department,  Washington,  D.  C. 

"Opportunities  for  service  in  the  field  of  occupational  therapy"  by  Lieu- 
tenant Colonel  Mattock. 

"Training  teachers  of  vocational  and  industrial  work  not  federally  aided" 
by  Professor  C.  A.  Bowman,  Stout  Institute,  and  W.  E.  Roberts,  Cleveland, 
Ohio. 

The  program  of  the  meeting  also  included  a  report  of  the  committee  on 
practice  teaching  which  was  concerned  with  plans.  One  of  the  best  of  these 
was  submitted  by  Professor  A.  F.  Siepert,  Bradley  Institute,  Peoria. 
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At  the  annual  meeting  of  the  Association  of 
A  Chance  to  Test  County  Superintendents  of  the  State  of  Illinois  held 
the  Rural  Schools  at  Springfield  on  December  29  a  committee  of  five  was 
appointed  to  facilitate  cooperation  with  the  Bureau  of 
Educational  Research  at  the  University  of  Illinois.  This  committee  is 
composed  of  the  following  members: 

G.  O.  Smith  (Chairman),  Bureau  County,  Princeton 

Mrs.  Lois  Coombes,  Moultrie  County,  Sullivan 

F.  E.  Crawford,  Fayette  County,  Vandalia 

Charles  H.  Watts,  Champaign  County,  Urbana 

J.  W.  McKinney,  Williamson  County,  Marion. 

The  immediate  objective  of  this  committee  is  to  increase  the  use  of 
standardized  tests  in  the  rural  schools.  Already  some  superintendents  have 
given  one  or  more  standardized  tests  in  all  the  schools  of  their  county  but 
it  is  the  feeling  of  the  county  superintendents  as  expressed  through  their 
state  association  that  the  use  of  standardized  tests  should  become  general 
throughout  the  state. 


The  difficulty  of  reaching  individual  rural  schools  from  one  center  such 
as  the  state  Bureau  of  Educational  Research  is  at  once  apparent.  However, 
the  relative  isolation  of  the  rural  teacher  creates  a  situation  in  which  a 
standardized  test  can  be  even  more  helpful  than  to  a  teacher  in  a  city  school 
system  who  is  working  under  close  supervision.  It  wiU  give  her  definite 
objectives  for  the  pupils  of  each  grade  and,  since  in  many  cases  she  has  a 
small  number  of  pupils,  it  will  be  possible  for  her  to  make  a  relatively  com- 
plete diagnosis  of  the  shortcomings  of  her  pupils.  If  these  valuable  instru- 
ments for  measuring  instruction  are  to  become  generally  used  in  rural 
schools,  it  is  incumbent  upon  county  superintendents  to  be  active  in  bringing 
them  to  the  attention  of  rural  teachers. 

The  action  of  the  county  superintendents  of  Illinois  represents  a  pro- 
gressive movement.  In  many  states  particular  county  superintendents 
have  been  using  standardized  tests  in  their  schools  for  some  years,  but  this  is 
thought  to  be  the  first  instance  of  concerted  action  by  all  of  the  county 
superintendents  of  a  state. 

Commissioner  P.   P.   Claxton  of  the  L^nited  States 
The  Federal  Bureau  of  Education  called  a  meeting  of  representatives 

Bureaa  and  from  a  number  of  the  larger  state  universities  at  the 

Educational  Hotel  Statler,  St.  Louis,  Missouri,  January  2  and  3,  1920. 

Research  This  meeting  was  attended  by  the  following  representa- 

tives : 
University  of  California:  R.  S.  French 
University  of  Illinois:  B.  R.  Buckingham  and  Walter  S. 

Monroe 
University  of  Kansas:  F.  J.  Kelly 
University  of  Michigan:  Guy  M,  Whipple 


Feb.  19Z0  NEWS  ITEMS  AND  COMMUNICATIONS  157 

University  of  North  Carolina:  L.  A.  Williams 
University  of  Pennsylvania:  J.  H.  Minnick 
University  of  Texas:  C.  T.  Gray 
In  addition  to  Commissioner  Claxton  his  assistant  Wm.  T.  Bawden  was 
in  attendance. 

Recently,  upon  the  invitation  of  the  Commissioner  of  Education, 
research  stations  have  been  established  at  a  number  of  universities.  In 
addition  to  the  institutions  represented  at  the  meeting,  the  following  appoint- 
ments have  been  made:  University  of  Iowa,  University  of  Minnesota, 
University  of  Virginia,  and  University  of  Washington. 

In  a  circular  issued  September  15,  the  purpose  of  the  plan  of  establishing 
research  stations  was  stated  as  follows: 

(1)  To  promote  scientific  research  in  education,  and  to  make  the  results  of  such 
research  available  to  students  of  education. 

(2)  To  utilize  in  a  national  way  such  special  resources  and  facilities  as  may  be 
placed  at  the  disposal  of  the  Bureau  of  Education  by  the  cooperating  institutions. 

(3)  To  coordinate  and  stimulate  the  educational  forces  available  in  the  cooperating 
institutions. 

(4)  To  bring  the  Bureau  of  Education  into  closer  relations  with  the 'educationa. 
agencies  of  the  country,  and  thereby  to  promote  the  Bureau's  understanding  of  educa- 
tional needs  and  problems,  and  to  extend  its  range  of  effective  service. 

This  move  upon  the  part  of  the  Bureau  of  Education  is  significant.  It 
means  first  a  closer  identification  of  the  Bureau  with  the  schools  of  education 
in  the  larger  state  universities.  It  also  means  that  the  United  States  Bureau 
of  Education  is  identifying  itself  with  the  rapidly  developing  recognition  of 
and  provisions  for  educational  research.  Within  a  period  of  Uttle  more  than 
five  years  there  has  developed  a  new  type  of  department  in  the  field  of  educa- 
tion, namely  a  department  which  has  for  its  particular  function  the  stimulat- 
ing and  directing  of  educational  research.  The  larger  portion  of  this  research 
is  carried  on  in  cooperation  with  public  schools.  The  recognition  of  this 
development  by  the  United  States  Bureau  of  Education  is  particularly 
significant  at  this  time  when  an  effort  is  being  made  to  secure  a  larger  recogni- 
tion for  education  throughout  the  country. 

From  the  standpoint  of  the  Bureau  of  Education,  this  move  will  mean 
that  it  will  assume  a  larger  place  in  the  educational  activities  of  the  country. 
It  is  a  lamentable  fact,  but  nevertheless  true,  that  the  recognition  given  to 
education  by  the  government  is  far  less  than  that  accorded  to  this  field  by 
most  governments.  If  the  establishment  of  research  stations  of  the  Bureau 
does  no  more  than  increase  the  prestige  of  the  United  States  Bureau  of 
Education,  the  project  will  be  justified. 


Nattnnal  AaBnriatton  nf  itr^rtnra  nf 

(E.  J.  ASHBAUGH,  Secretary  and  Editor) 


All  aboard  for  Cleveland! 

There  is  every  reason  why  this  meeting  should  be  the  banner  meeting  of 
the  National  Association  of  Directors  of  Educational  Research.  The  pro- 
gram has  been  prepared  earlier  than  ever  before.  A  larger  amount  of  time 
wiU  be  given  to  the  discussion  of  the  problems  of  research  men.  Every 
member  is  urged  to  go  through  the  program  carefully  and  then  decide  that 
he  cannot  afford  to  miss  this  meeting. 

Special  attention  is  called  to  the  closed  meeting  on  Monday,  February  23. 
This  is  to  be  a  meeting  for  members  only  and  will  be  devoted  to  intimate 
discussion  of  problems  of  research.  Each  member  should  come  to  the 
meeting  prepared  to  submit  a  small  list  of  carefully  defined  problems  for  this 
discussion.  From  the  standpoint  of  the  membership  it  should  be  the  most 
valuable  day  of  the  whole  week. 


In  order  to  get  off  right  foot  first  with  the  Journal,  your  secretary  has 
sent  out  a  notice  to  the  members  asking  their  intention  concerning  continu- 
ing membership  this  next  year.  Almost  100  percent  rephes  have  been 
received  and  with  but  a  single  exception  the  statement  has  been  affirmative. 
The  one  negative  vote  is  from  a  former  member  who  is  not  nov/  engaged 
in  research  work.  A  few  have  pledged  themselves  for  membership  for  life. 
This  is  the  spirit  that  wins. 


Since  the  writing  of  the  notes  for  the  last  issue,  word  has  reached  us  that  the 
five  million  dollar  bond  issues  that  were  then  pending  in  Omaha  and  Oakland 
were  both  carried  by  a  good  substantial  majority.  There  is  every  evidence 
that  the  great  American  public  is  behind  the  public  schools  more  emphatically 
than  ever.  It  certainly  vindicates  also  the  impression  which  many  of  us  have 
had  that  people  are  perfectly  willing  to  tax  themselves  for  the  education  of 
their  children  when  the  facts  showing  conditions  and  needs  are  placed  before 
them  in  a  clear,  concise  manner.  Mr.  Smith  and  Mr.  Dickson  should  both 
receive  the  unanimous  commendation  of  the  members  of  the  Association  for 
the  success  of  the  work. 


Mr.  Shapleigh,  Research  Secretary,  Buffalo  Public  Educational  Associa- 
tion, Buffalo,  New  York,  should  be  congratulated  upon  the  issuance 
of    an    educational    journal    for    the    city — School    and    Community — two 
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issues  of  which  have  reached  the  secretary's  desk.  Both  represent  a 
very  high  degree  of  excellence  in  both  content  and  composition.  Other  school 
communities  of  large  size  can  certainly  aflord  to  use  similar  means  of  keeping 
the  public  well  informed.  Wise  publicity  would  very  quickly  drive  out  of 
existence  the  contemptible  type  of  cartoon  of  schools  and  school  conditions 
which  so  often  disgraces  the  pages  of  our  public  press. 


We  are  glad  to  welcome  to  membership  in  our  Association:  Charles  L. 
Harlan,  Department  of  Educational  Measurement  and  Standards,  Lewiston 
State  Normal  School,  Lewiston,  Idaho,  and  John  K.  Norton,  Assistant 
Director,  Bureau  of  Research  and  Guidance,  Oakland  Public  Schools, 
Oakland,  California. 


If  a  member  knows  of  any  directors  of  educational  research  who  are  not 
now  members,  he  will  confer  a  favor  upon  the  Association  by  recommending 
to  the  secretary  such  of  them  as  he  believes  to  be  acceptable  for  membership. 
If  this  notice  should  come  to  the  attention  of  any  one  who  is  not  a  member  of 
the  Association  but  who  is  engaged  primarily  in  educational  research,  a  letter 
to  the  secretary  will  bring  him  information  concerning  eligibility  to  member- 
ship and  the  general  scope  and  benefits  of  the  Association. 


Please  remember  that  no  further  issues  of  the  news  bulletin  will  be  made. 
New  items  from  the  various  members  are  to  be  given  publicity  through  this 
department.  The  secretary  urges  the  members  to  feel  under  personal  obliga- 
tion to  send  him  items  concerning  their  work.  Whenever  you  have  completed 
a  bit  of  research  which  you  feel  has  been  helpful  to  yourself  or  to  your  com- 
munity; whenever  you  start  something  which  is  out  of  the  regular  roucine; 
whenever  you  have  a  piece  of  projected  work  to  which  you  think  other  mem- 
bers might  contribute  some  comparable  data,  please  spend  a  few  minutes 
time  and  a  postage  stamp  in  getting  these  data  to  the  secretary. 


At  the  closed  meeting  of  the  Association  which  will  be  held  on  Monday, 
February  23,  topics  of  especial  interest  to  the  members  will  be  taken  up. 
None  but  members  will  be  expected  to  attend  unless  they  are  particularly 
invited  to  do  so.  Among  others.  Dr.  Thorndike  will  address  the  closed  meet- 
ing by  invitation.  He  is  going  to  talk  on  "Measurements  of  instruments  of 
instruction"  (i.e.,  textbooks).     He  intimates  that  he  will  "start  something." 

A  number  of  topics  of  general  interest  to  members  will  be  proposed  and 
leaders  of  discussion  will  be  appointed.  The  following  topics  have  been 
suggested:  the  improvement  of  instruction  by  the  use  of  standardized 
tests,  the  evaluation  of  tests,  group  intelligence  tests.  If  any  of  the  members 
wishes  to  have  a  topic  discussed  he  should  communicate  the  fact  to  the 
president  at  once.  While  the  meeting  will  not  be  of  a  formal  character  it  will 
nevertheless  be  definitely  planned;  and  it  may  be  difficult  to  secure  the 
discussion  of  a  topic  unless  a  place  has  been  arranged  for  it. 

For  the  use  of  the  closed  meeting  the  management  of  the  Hotel  Statler 
has  placed  at  the  disposal  of  the  association  a  committee  room  having  a 
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seating  capacity  of  forty.  Adjoining  this  room  there  will  be  a  private  dining 
room  where  luncheon  and  dinner  will  be  served  to  the  members.  The  use 
of  the  committee  room  is  given  to  the  association  gratis;  but  the  members 
will  be  expected  to  eat  luncheon  and  dinner  in  the  dining  room  assigned  to 
the  Association.    They  would  anyway! 

At  this  meeting  a  preliminary  report  of  the  committee  on  standards  will 
be  rendered.  The  report  will  be  open  for  discussion.  The  closed  meeting  will 
also  afford  an  opportunity  for  an  informal  discussion  of  business  matters. 
This  will  enable  us  to  dispose  of  them  quickly  at  the  business  meeting  Thurs- 
day evening.  If  any  member  has  an  item  of  business  which  he  desires  to  have 
debated  he  may  bring  it  up  at  the  closed  meeting. 


The  following  papers  are  announced  for  the  public  meeting  to  be  held 

Thursday  morning  and  afternoon,  February  26: 

W.  W.  Theisen.     "Provision  for  individual  differences  in  the  teaching 

of  reading." 

H.  A.  Brown.     "Formulation  of  method  in  reading  ia  the  light  of  recent 

investigations." 

William  S.  Gray.     "Significant  tendencies  in  the  diagnosis  of  reading 

accomplishment." 

Edward  L.  Thorndike.     "Intelligence  tests  for  college  entrants." 

F.  J.  Kelly.     "Results  of  three  methods  of  teaching  the  fundamentals 

of  arithmetic,  measured  by  the  Courtis  Tests." 

Cecile  White  Flemming.     "Reading  ability  and  intelligence." 

S.  A.  Courtis.     "Report  of  committee  on  standards." 

Leonard  P.   Ayres.     "The  comparative  effectiveness  of  state  school 

systems." 

Arthur  W.  Kallom.  "Reproduction  as  a  measure  of  reading  ability." 
J.  W.  Richardson.  "The  campaign  method  in  elementary  education." 
As  will  be  noticed,  the  program  is  largely  grouped  around  the  ideas 

of  reading  and  intelligence  testing. 

The  annual  dinner  will  take  place  on  Thursday  evening  at  6:30  o'clock 

at  the  Hotel  Statler.    Price  per  plate  $3 .  00. 
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A  PROPOSED  INDEX  OF  EFFICIENCY  IN  TEACHING 
UNITED  STATES  HISTORY 

B.  R.  Buckingham 

University  of  Illinois 

When  a  supervisor  enters  a  classroom  to  inspect  the  work  and 
rate  of  the  teacher,  he  carries  with  him  a  set  of  more  or  less 
variable  personal  standards.  He  may  also  fortify  himself  with  a 
schedule  of  qualities  on  the  basis  of  which  he  will  perhaps  beheve 
that  he  is  scientifically  evaluating  the  work  of  the  teacher.  We 
have  a  number  of  score  cards  which  set  up  such  captions  as 
personality,  voice,  neatness,  method,  control,  and  the  like. 
These  are  by  no  means  satisfactory.  Teachers  possessing  these 
qualities  to  a  high  degree  may  nevertheless  be  poor  teachers. 
Personality  as  a  producing  agency,  neatness  functioning,  voice 
used  to  get  results,  method  which  does  the  business,  and  control 
which  facilitates  work — these  qualities,  in  other  words,  not  as 
possessions  of  the  teacher  but  as  productive  of  changes  in  pupils — 
are  touchstones  of  good  teaching. 

We  must,  therefore,  seek  for  teaching  efficiency  in  the  changes 
produced  in  children  rather  than  in  the  qualities  possessed  by 
teachers.  We  are  not,  however,  to  suppose  that  we  have  greatly 
simplified  our  problem  when  we  have  thus  defined  it.  The  results 
of  teaching  are  numerous  and  far  reaching.  We  can  never  hope 
to  measure  all  of  them,  for  they  multiply  to  the  end  of  life. 

Yet  we  are  not  without  means  of  measuring  with  a  considerable 
degree  of  accuracy  the  efiiciency  of  teaching.  What  we  need  to 
do  is  to  find  some  one  major  result  the  simplicity  of  which  makes 
its  apprehension  relatively  easy  and  the  relationship  of  which  to 
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the  totality  of  result  is  close.  If  there  were  a  perfectly  definable 
and  generally  recognized  relation  between  the  length  of  the  left 
forefinger  and  the  stature  of  a  human  being,  and  if  it  were  difl&cult 
to  measure  stature  but  easy  to  measure  finger  length,  then  the 
height  of  human  beings  might  very  probably  be  expressed  not 
directly  but  indirectly  through  the  measurement  of  the  left  fore- 
finger. Countless  uses  are  made  of  the  principle  of  directly  meas- 
uring a  magnitude  in  order  that  another  magnitude  related  to  it 
may  be  indirectly  measured.  A  printer  often  counts  the  material 
in  a  pile  by  measuring  its  height  or  weight.  Taxes  have  been 
assessed  according  to  the  number  of  windows  in  the  houses  because 
the  value  of  the  house  and  hence  the  wealth  of  its  owner  were 
thought  to  be  roughly  proportional  to  the  number  of  windows. 
We  weigh  the  air  by  measuring  the  height  of  a  column  of  mercury 
which  it  will  sustain;  and  the  weight  of  the  air  is  itself  functionally 
related  to  the  weather  conditions  which  we  are  thus,  in  turn, 
able  to  estimate.  Again,  we  directly  measure  the  expansion  of  a 
fluid  in  a  tube  and  thereby  indirectly  measure  temperature. 

In  the  matter  of  teaching  it  is  necessary  in  the  first  place  to 
seek  our  index  of  eflaciency  among  the  results  of  the  teaching. 
In  the  second  place,  it  is  desirable  that  this  index  shall  be  of  a 
simple  and  easily  measurable  nature. 

Some  of  the  results  of  teaching  are  being  measured  objectively 
by  means  of  standardized  tests  and  scales.  Opposition  to  edu- 
cational measurement  as  such  is  all  but  silenced.  Not  many 
voices  are  now  being  raised  against  it  on  princ  pie.  Numerous 
critics,  however,  assail  its  practical  applications  and  they  do  so  at 
many  points  and  in  many  ways. 

It  is  not  unusual,  for  example,  for  the  critic  to  contend  that 
certain  subjects  do  not  lend  themselves  to  measurement.  This 
assumption  is  a  dangerous  one,  and  when  the  critic  is  so  rash  as 
to  make  his  objections  apply  to  a  particular  subject  he  is  likely 
to  be  refuted  by  the  next  educational  periodical  or  bulletin.  In 
1913,  when  measurement  had  been  applied  for  two  or  three  years 
to  handwriting  and  arithmetic,  it  was  pretty  generally  believed 
that  these  two  subjects  might  be  susceptible  to  such  treatment, 
but  that  one  could  go  no  further.  In  particular,  it  was  roundly 
asserted  by  a  speaker,  and  cordially  approved  by  his  hearers, 
that  spelling  was  a  subject  that  would  never  yield  to  measure- 
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ment.  Yet  everyone  knows  that  to  measure  the  spelling  ability 
of  pupils  is  one  of  the  first  steps  of  the  novice  in  measurement. 
Similarly,  nobody  thought  that  ability  in  reading  could  be  mea- 
sured, yet  the  sale  of  millions  of  copies  of  reading  tests  now  assures 
us  that  its  measurement  is  at  least  being  widely  attempted,  and 
that  people  believe  they  are  securing  reasonably  reliable  results. 

In  the  case  of  United  Sates  history,  there  is  evidently  a  phase 
of  the  subject  which  lends  itself  admiarbly  to  measurement.  The 
method  of  expressing  the  difficulty  of  the  elements  in  any  test 
has  been  carefully  worked  out.  It  has,  therefore,  become  per- 
fectly feasible  to  apply  this  method  to  any  subject,  the  difficulty 
of  whose  elements  can  be  determiend  One  definition  of  diffi- 
culty— not  the  only  one,  to  be  sure,  but  one  which  is  especially 
significant — is  the  proportion  of  correct  responses  to  the  task  in 
question.  When  did  Columbus  discover  America?  Who  was 
president  of  the  Southern  Confederacy?  What  two  probable 
European  ventures  was  the  Monroe  Doctrine  set  forth^to  fore- 
stall? These  are  matters  whose  difficulty  on  the  basis  of  the  pro- 
portion of  correct  responses  may  be  as  accurately  determined  as 
the  difficulty  of  the  number  combinations  or  of  the  spelling  of 
words. 

"Arrange  the  following  events  in  the  order  in  which  they 
occurred"  says  one  author  of  a  history  test.  Since  there  is  but 
one  order  of  occurrence  and  that  order  is  a  matter  of  record  about 
which  there  can  be  no  dispute,  this  question  is  likewise  one  whose 
difficulty  can  easily  be  determined.  Adopting  one  of  the  devices 
of  the  Army  Test  whereby  a  number  of  ends  of  sentences  are 
given  with  instructions  to  the  subject  to  underscore  the  right  one, 
another  author  gives  questions  of  this  type:  "The  Huguenots 
first  set.tled  in  Baltimore,  Boston,  Charleston,  New  York,  Phila- 
delphia'^ Or  again,  "The  Patroons  were  Dutch  fishermen,  fur- 
traders,  land  owners,  miners,  preachers,  teachers."  Again  there  is 
only  one  correct  response  and  its  correctness  is  not  questioned  by 
quahfied  persons.  Many  other  types  of  questions  might  be 
listed — questions  the  responses  to  which  are  either  undoubtedly 
right  or  undoubtedly  wrong.  Asking  the  names  of  men  to  be 
connected  with  events;  requiring  the  selection,  from  a  given  list, 
of  the  policies  or  events  favored  by  a  given  party;  the  association 
of  events  with  dates,  of  causes  with  effects,  of  men  with  policies. 
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with  principles,  or  with  each  other;  the  classification  of  men  or 
events  in  various  accepted  ways — these  are  some  of  the  types  of 
exercises  now  being  used.  As  to  the  form  which  answers  may 
take,  there  is  also  an  increasing  richness  and  variety.  One  of  the 
earlier  devices  was  to  print  a  question  in  a  box  and  require  the 
answer  to  be  written  in  it.  Numbers  are  used  to  indicate  facts, 
particularly  facts  regarding  the  sequence  or  importance  of  events. 
Instead  of  requiring  the  pupil  to  write  out  the  names  of  men, 
events,  measures,  policies,  etc.,  a  number  of  these  are  printed  and 
check  marks  are  required.  The  true-false  type  of  test  has  been 
introduced.^  It  consists  of  a  series  of  statements,  some  of  which 
are  true  and  some  of  which  are  false  and  the  pupil  is  required  to 
indicate  the  truth  or  falsity  of  each  statement.  The  completion 
type  of  test  has  been  with  us  a  long  time  and  has  proved  exceed- 
ingly useful. 

But  in  order  to  be  certain  that  responses  to  questions  are 
either  right  or  wrong,  the  questions  must,  clearly,  be  questions  of 
fact.  One  may  admit  the  ease  with  which  such  questions  may  be 
rated  and  the  cleverness  of  authors  in  arranging  fact  tests  and  yet 
remain  in  doubt  as  to  the  value  of  the  results  of  such  tests  as 
measures  of  ability  in  history  or  of  the  efl&ciency  of  the  teaching 
of  history.  The  problem  then  resolves  itself  into  this:  granted 
that  fact  questions  are  easy  to  devise  and  easy  to  rate,  what 
meaning  can  we  give  to  the  results?  The  critics  of  measurement 
have  all  along  been  saying  that  the  measurers  were  formalizing 
education,  that  only  the  least  valuable  subjects  or  parts  of  sub- 
jects could  be  measured,  in  short,  that  the  only  appeal  was  to 
the  memory  or  to  a  few  simple  skills  such  as  those  involved  in 
handwriting. 

There  are  those  who  seem  to  think  that  memory  was  given 
us  as  a  human  attribute  only  to  be  despised.  In  the  vocabulary 
of  the  modern  pedagogical  writer,  the  word  memory  is  only  used 
in  a  deprecatory  sense.  In  my  own  judgment,  the  case  against 
memory  has  been  vastly  overstated.  This  opinion,  however, 
will  not  be  urged  in  this  connection.  But  it  will  be  apparent  as 
we  proceed  that,  even  when  we  think  we  are  appealing  to  a  sup- 
posedly higher  process,  we  may  really  be  dealing  only  with  a 
somewhat  higher  form  of  memory. 

*  McCall,  W.  A.  "A  new  kind  of  school  examination,"  Journal  of  Educationa 
Research,  1 :33-46,  January,  1920. 
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Fact  questions  are  those  questions  whose  correct  answers  are 
facts.  Observe,  that  the  determination  of  whether  a  question  is 
a  fact  question  or  not  depends  upon  the  character  of  the  answer 
which  is  accepted  as  satisfactory.  We  may  ask  a  child  what  he 
thinks  were  the  results  of  the  War  of  1812;  but  if  we  only  credit 
him  with  a  satisfactory  answer  when  he  tells  the  actual  results  of 
the  war,  we  are  dealing  with  a  fact  question,  no  matter  how  we 
delude  him  or  ourselves  with  the  notion  that  he  is  fancy-free, 
because  we  have  asked  him  what  he  thinks.  A  fact  question 
appeals  to  the  memory.  It  may  be  a  date  or  a  name,  an  incident 
or  an  event,  a  policy  or  a  movement,  a  cause  or  an  effect,  an 
evaluation  or  a  relationship.  It  may  be  bald  and  meaningless 
or  it  may  be  significant,  and  even  surcharged  with  emotion. 

It  appears,  therefore,  that  these  fact  questions — however 
rich  they  may  be  in  meaning — are  nevertheless  capable  of  being 
objectively  rated  and  easily  scored. 

If,  therefore,  it  can  be  established  that  test  scores  on  fact 
questions  are  directly  related  to  the  thing  we  call  historical  ability, 
we  shall  be  justified  in  measuring  historical  ability  by  means  of 
the  ability  to  answer  fact  questions.  This  relationship  may  be 
mathematically  established  if  we  can  secure  from  the  same  group 
of  pupUs  two  sets  of  measures:  (1)  scores  on  fact  questions  and 
(2)  scores  in  historical  ability.  I  am  not  sure  that  I  know  what 
historical  ability  is.  Doubtless,  psychologically  speaking,  there 
is  no  such  thing  as  historical  ability  but  only  many  different 
historical  abilities;  in  other  words,  the  ability  is  probably  plural 
rather  than  singular.  I  presume,  however,  that  we  shall  come 
somewhere  near  the  conception  of  historical  ability  if  we  secure 
measures  of  ability  to  think  correctly  and  to  judge  characters 
correctly  in  the  field  of  history.  At  least  in  the  most  elaborate 
and  carefully  analyzed  history  test,  namely  that  of  Van  Wagenen,^ 
the  assumption  appears  to  be  made  that  historical  ability  is  rather 
fully  covered  when  we  have  taken  into  account  information, 
thought,  and  character  judgment. 

'  Van  Wagenen,  M.  J.  Historical  information  and  judgment  in  pupils  of  demenlary 
schools.    New  York:  Teachers  College,  Columbia  University,  1919. 

Van  Wagenen,  M.  J.  American  History  Scales  (Information  Scale,  Series  A  and  B; 
Thought  Scale,  Series  A  and  B;  and  Character  Judgment  Scale,  Series  A,  B,  and  L). 
Published  by  Teachers  College,  Columbia,  University,  New  York,  1919. 
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Granted  that  this  is  true,  two  problems  challenge  our  atten- 
tion: First,  the  extent  to  which  ability  to  think  and  to  judge 
character  in  the  field  of  history  depends  upon  a  knowledge  of 
facts;  and  second,  the  extent  to  which  thought  and  character- 
judgment  questions  (using  those  of  Van  Wagenen  as  typical)  are 
reaUy  fact  questions. 

In  1915  I  submitted  certain  fact  questions  and  certain  thought 
questions  to  some  elementary  school  children  in  New  York.  A 
little  more  than  a  year  later  I  gave  a  different  series  of  fact  and 
thought  questions  to  elementary  and  high-school  pupils  at  Madi- 
son, Wisconsin.  I  found  a  correspondence  between  the  ability 
to  answer  these  fact  and  thought  questions  which  may  be  mathe- 
matically expressed  by  a  correlation  coefficient  of  about  +0.4.^ 
I  also  found  that  if  one  child  scores  a  unit  higher  than  another 
on  the  fact  questions,  he  would  also,  on  the  average,  score  0.89 
of  a  unit  higher  on  the  thought  questions.  From  these  facts, 
I  derived  an  equation  which  would  permit  the  probable  score  in 
the  thought  questions  to  be  forecast  from  a  known  score  in  the 
fact  questions  with  the  chances  even  that  the  prediction  would  not 
vary  more  than  two  out  of  a  possible  twenty  points  from  the  score 
which  would  be  obtained  by  actually  administering  the  thought 
questions. 

The  far  more  extensive  testing  of  Van  Wagenen  yielded  even 
higher  correlations.  Between  his  fact  scores  and  thought  scores 
he  found  a  correlation  of  +0.80  and  between  his  fact  scores  and 
character  judgment  scores  the  correlation  was  +0.78. 

The  correlations  reported  by  Van  Wagenen  are  for  seventh 
and  eighth  grades.  I  gave  his  tests  to  pupils  in  two  high  schools, 
one  at  Champaign,  Illinois,  and  the  other  at  Danville,  Illinois, 
and  obtained  correlations  between  fact  and  thought  scores  of 
+0.53   and    +0.60   respectively.     Between   fact  and   character 

*  The  reader  who  is  unfamiliar  with  the  correlation  coeflBcient  may  get  a  rough 
and  ready  idea  of  its  meaning  by  considering  that  if  two  series  of  measures — e.g., 
scores  in  fact  questions  and  scores  in  thought  questions — are  perfectly  and  directly- 
related,  the  correlation  coefficient  is  +1.00.  Under  these  circumstances  the  larger 
one  measure  is  the  larger  the  other  will  be.  If  the  measures  are  not  related  to  each 
other  at  all,  the  correlation  coefficient  is  zero.  Coefficients  between  0  and  +1.00 
indicate  closer  direct  relationship  the  more  nearly  they  approach  -|-1 .00.  A  coefficienL 
of  -1-0.4  indicates  a  well-marked  tendency  for  the  two  measures  in  question  to  varv 
together;  but  it  also  indicates  a  rather  large  number  of  exceptions  to  the  tendency. 
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judgment  scores  the  correlations  were  +0.45  and  +0.43  re- 
spectively. 

As  between  fact  and  thought  scores,  the  relation,  therefore, 
seems  to  be  very  close.  My  high-school  results  are  not  as  high 
as  Van  Wagenen's  seventh  and  eighth  grade  results  because  the 
thought  test  (a  test  which  Van  Wagenen  used  in  grades  as  low 
as  the  fourth)  proved  to  be  too  easy  to  distinguish  thought 
ability  among  the  more  capable  children.  But  if  in  grades  for 
which  these  fact  and  thought  questions  are  appropriate  the 
correlation  is  +0.80,  we  are  justified  in  saying  that  the  two  tests 
tell  much  the  same  story — in  other  words,  that,  after  having  given 
the  Van  Wagenen  information  test,  we  shall  gain  little  by  giving 
his  thought  test. 

Nothing,  therefore,  either  in  Van  Wagenen's  testing  or  mine 
justifies  one  in  attempting  to  measure  all  the  desirable  outcomes 
of  history  teaching.  Fact  scores  seem  to  be  surprisingly  sufficient. 
Moreover,  thought  and  character  judgment  are  hard  to  rate; 
and  one  rater  cannot  be  altogether  consistent  either  with  another 
or  with  himself  at  another  time.  Accordingly,  any  added  con- 
tribution which  the  testing  of  such  abilities  may  make  to  our 
estimate  of  "general  ability"  in  history  will  not  only  be  small  but 
will  be  measured  with  uncertainty. 

To  be  sure,  thought  and  character  judgment  do  not  represent 
all  the  desirable  outcomes  of  history  teaching.  We  wish  our 
pupils  to  grasp  the  meaning  and  significance  of  historical  situa- 
tions, to  apprehend  changing  standards  of  life,  to  judge  the 
reliability  of  historical  material  or  evidence,  to  distinguish  be- 
tween statements  of  fact  and  statements  of  opinion.  This  list 
of  aims  is  taken  almost  verbatim  from  Van  Wagenen;  and  doubt- 
less it  could  be  extended.  But  as  to  these,  may  they  not  all  be 
shown  to  rest  upon  a  knowledge  of  facts?  How  may  one  "grasp 
the  meaning  and  significance  of  historical  situations"  unless  one 
has  at  hand  the  facts  about  the  situations  and  the  additional 
facts  which  will  give  them  "meaning  and  significance"?  How 
may  one  "apprehend  the  changing  standards  of  life"  unless  one 
knows  what  the  standards  were  before  and  after  the  changes 
took  place?  How  may  one  "judge  the  reliability  of  historical 
material  or  evidence"  unless  one  knows  the  material  and  the 
evidence  in  question  and  the  facts  or  criteria  on  which  their 
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reliability  depends?  Finally,  how  may  one  "distinguish  between 
statements  of  fact  and  statements  of  opinion" — except  so  far  as 
the  form  of  the  statement  itself  furnishes  the  distinction — without 
knowing  the  facts  in  the  case? 

These  queries  lead  to  the  statement  that  a  knowledge  of 
facts — information,  as  Van  Wagenen  calls  it — is  symptomatic  of 
higher  abilities  in  history.  The  evidence  supporting  this  view 
arises  not  only  from  the  fact,  as  shown  above,  that  pupils  who 
know  facts  will  also  think  and  judge  well  but  also  from  two 
further  conditions.  First,  we  may  extend  the  term  "facts"  to 
include  exact  information  of  any  nature  in  the  field  of  history — 
information  not  only  as  to  dates,  persons,  and  places  but  also  as 
to  causation,  relationship,  political  and  social  movements,  eco- 
nomic developments,  religious  beliefs,  wars  and  rumors  of  wars, 
peace  and  the  arts  of  peace.  Second,  knowledge  of  facts  condi- 
tions higher  abilities  because  many  items  usually  included  under 
these  higher  abilities  are  in  reality  essentially  factual.  Since 
Van  Wagenen  is  the  first  test  maker  to  present  a  thoroughly 
worked  out  scheme  of  items  other  than  those  of  information,  we 
may  profitably  consider  some  of  them.  I  shall  examine  the  first 
four  questions  of  his  Thought  Scale,  Series  A,  together  with  his 
acceptable  answers  to  those  questions. 

The  first  reads  as  follows:  "Before  the  steamboats  were  made 
people  used  to  travel  on  the  ocean  in  sail  boats.  Steamboats 
were  not  made  until  a  long,  long  time  after  the  European  people 
came  to  make  their  homes  in  America.  How  do  you  think  these 
early  European  settlers  came  to  America?"  The  acceptable 
answer  is  "in  sail  boats"  and  it  is  a  fact.  Therefore  the  question 
is  a  fact  question  although  introduced  by  the  words,  "How  do 
you  think." 

The  second  thought  question  reads:  "A  little  before  the  year 
1500  the  people  of  Europe  were  anxious  to  find  a  new  way  to  get 
to  India.  Some  people  thought  that  India  might  be  reached 
by  sailing  westward  across  the  Atlantic  Ocean.  Columbus  was 
one  of  these  people.  It  was  at  this  time  that  Columbus  found 
America.  What  do  you  think  Columbus  was  looking  for  when 
he  found  America?"  Full  credit  is  allowed  for  any  of  the  follow- 
ing responses:  "A  short  route  to  India";  "India";  "Western 
passage  to  India";  "Western  route  to  India";  "Northwest  passage 
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to  India;"  "New  way  to  India;"  "A  way  to  India;"  "An  easy 
way  to  India."  Here  again  the  answers  accepted  are  facts,  and 
the  question  is,  therefore,  a  simple  fact  question.  The  child  is 
asked  what  he  thinks  Columbus  was  looking  for,  but  evidently 
no  thinking  is  expected. 

The  third  question  on  the  Thought  Scale  reads:  "A  hundred 
years  ago  it  took  a  letter  several  days  to  go  from  New  York  to 
Boston.  Today  it  takes  only  a  few  hours.  Why  do  you  think 
it  took  letters  so  much  longer  to  go  to  Boston  100  years  ago  than 
it  does  today?"  These  answers  are  allowed  full  credit:  "A  hun- 
dred years  ago  there  were  no  railroads;"  "no  trains  or  steamships;" 
"travel  by  stage  coach  or  horses."  Upon  what,  then,  does  the 
ability  to  answer  the  question  correctly  depend?  Does  it  not 
clearly  depend  upon  a  knowledge  of  facts? 

Question  four:  "The  Northmen  probably  came  to  America 
as  early  as  the  year  1000,  nearly  500  years  before  Columbus  and 
the  Cabots  sailed  from  Europe.  There  is  no  record  of  any  one 
else  having  come  to  America  before  the  year  1000.  By  whom 
do  you  think  America  was  first  discovered?"  Acceptable  answers 
are:  "The  Northmen,"  "Vikings,"  and  "Lief  Ericcson."  If  we 
ask  what  enables  a  child  to  answer  "Vikings"  or  "Lief  Ericcson" 
are  we  not  obliged  to  say  that  it  is  a  knowledge  of  facts?  The 
thought  element  in  all  these  questions  is  only  in  the  form — a  form 
which  employs  the  word  "think." 

Not  all  of  the  questions  on  the  Van  Wagenen  Thought  Test 
are  so  obviously  factual,  but  most  of  them  are;  and  some  of  those 
which  are  not,  call  for  thinking  which  has  no  necessary  reference 
to  history. 

I  shall  not  examine  in  detail  the  questions  in  character  judg- 
ment. Each  consists  first  of  a  narrative  and  then  of  a  requirement 
to  underline  three  of  ten  adjectives  which  best  describe  some 
character  or  group  of  characters  in  the  narrative.  Reading  and 
language  ability  are  necessary  and  almost  sufiicient  for  success. 
Facts  play  no  part  except  as  they  are  given  in  the  narratives; 
and  no  other  products  of  instruction  in  history  appear  to  be 
required. 

Whatever,  therefore,  may  be  the  desirable  outcomes  of  the 
teaching  of  history,  it  does  not  appear  to  be  necessary  that  a 
valid  test  should  require  reactions  with  reference  to  all  of  them. 
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It  may  merely  require  reactions  which  are  symptomatic  of  them. 
In  other  words,  we  may  distinguish  between  the  content 
and  method  of  teaching  on  the  one  hand,  and  the  content  and 
method  of  testing  on  the  other.  Many  do  not  believe  this;  they 
regard  tests  as  teaching  devices,  or  at  least  as  encouraging  certain 
types  of  teaching.  This  is  not  always  true,  and  may  never  be 
true  in  a  content  subject  such  as  history.  A  test,  to  be  a  valid 
measuring  instrument,  must  provide  a  reliable  quantitative  state- 
ment which  varies  in  direct  proportion  to  the  ability  or  abiHties 
v/hich  we  seek  to  measure.  It  may  be  one  of  the  complex  of 
abilities.  It  may — theoretically  at  least — be  something  which 
is  not  a  historical  ability  at  all  just  as  the  expansion  of  a  liquid  in 
a  column  is  not  temperature.  If  it  is  supposed  that  by  setting 
up  fact  tests  we  encourage  formal  fact  teaching,  this  supposition 
may  itself  be  in  error.  The  fact  test  can  be  as  meaningful  as  we 
desire  to  make  it.  As  I  have  pointed  out,  our  facts  may  far 
transcend  those  of  dates,  persons,  and  places.  Again,  it  will  be 
found  that  the  mere  teaching  of  formal  facts  will  do  little  to  enable 
a  child  to  pass  a  well-constructed  fact  test  in  history  because 
the  right  kind  of  facts  are  not  learned  by  a  dead  lift  of  the  memory 
but  by  discussion  and  reflection,  by  collateral  reading  and  self- 
expression. 

If.  after  giving  a  fact  test,  we  should  desire  to  know  how 
capable  the  pupils  probably  would  be  in  other  ways,  we  may  infer 
this  with  substantial  accuracy  without  giving  any  other  test.  Sup- 
pose, for  example,  that  an  instructor  has  given  the  Van  Wagenen 
information  test  and  wishes  to  infer  the  composite  ability  of  the 
pupils  to  think  and  to  judge  character.  The  teacher  may  do  this 
provided  the  relationship  has  been  established  between  scores  in 
the  information  test  and  the  combined  scores  in  the  thought  and 
character  judgment  tests.  The  correlation  coefficient  expresses 
a  relationship  but  not  in  usable  form  for  this  purpose.  As  a 
result  of  the  testing  carried  on  in  the  high  schools  at  Champaign 
and  Danville,  we  derived  an  equation  by  which  the  required 
inference  may  be  made.  This  equation  was  y  =  72.S-{-0.9x.* 
A  number  of  applications  of  this  equation  were  made  and  most  of 
them  yielded  results  in  close  conformity  with  the  actual  test 

*  Such  an  equation  is  called  a  regression  equation.  In  this  case,  x  stands  for  the 
fact  scores  and  y  for  the  combined  scores  in  thought  and  character  judgment. 
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1 
results.  The  first  pupil  in  our  alphabetical  arrangement  had  a 
score  in  the  information  test  of  33.  Substituting  this  for  x  in 
the  equation  we  find  that  3^  =  103.5.  This  then  is  the  inferred 
score  in  thought  and  character  judgment  combined.  The  real 
score  was  exactly  100. 

The  prophesy,  however,  does  not  always  work  as  well  as  this. 
The  second  pupil  in  the  alphabetical  arrangement  scored  36  on 
the  information  test.  When  this  value  is  substituted  for  x  in 
the  equation,  it  yields  a  theoretical  score  of  105.2.  The  real 
score  was  114.  Thus  the  prophesy  is  8.8  units  less  than  the 
actuality. 

It  will  be  interesting  to  have  a  general  expression  for  the 
accuracy  that  a  teacher  may  expect  from  the  use  of  this  equation. 
The  equation  only  purports  to  give  the  score  that  on  the  average 
would  be  obtained  by  giving  the  thought  and  character  judgment 
tests  a  large  number  of  times.  In  any  individual  instance  the 
chances  are  found  to  be  even  that  the  score  obtained  from  the 
equation  will  differ  from  the  score  obtained  by  actual  testing  by 
not  more  than  eight  units.  Since  there  are  144  units  in  the 
combined  thought  and  character  judgment  tests,  the  chances 
are  one  to  one  (or  we  may  say  an  even  bet)  that  the  score  obtained 
from  the  equation  will  be  within  about  5  percent  of  the  true  result. 

Thus  we  have  given  data  and  inferences  to  support  the  possi- 
bility of  indirect  measurement  in  history.  The  doctrine  of 
indirect  measurement  requires  us  to  find  a  magnitude  which  is 
easy  to  measure  and  which  also  varies  closely  with  the  more  com- 
plex magnitude  which  we  wish  to  measure  but  to  which  it  is 
difficult  to  apply  our  instruments.  It  is  maintained  that  fact 
questions — when  the  term  fact  is  given  its  full  and  proper  mean- 
ing— afford  an  easy  means  of  measurement  because  of  the  unequiv- 
ocal character  of  the  responses  and  that  these  responses  vary 
reasonably  closely  with  what  we  are  thus  far  able  to  set  up  as 
higher  abilities  in  history.  We  have  pointed  out  that  the  most 
notable  attempt  to  measure  two  of  these  higher  abilities  has  not 
succeeded  in  getting  far  away  from  a  fact  basis.  It  is  also  urged 
that  a  distinction  be  made  between  methods  of  teaching  and 
methods  of  test  making;  and  that  if  the  type  of  testing  which  we 
adopt  is  thoroughly  significant  in  the  sense  that  it  varies  with 
the  higher  abilities,  we  shall  be  encouraging  the  training  of  these 
higher  abilities  when  we  use  it. 


THE  SELF-SURVEY  IN  THE   ELEMENTARY    SCHOOL: 
AN  EXPERIMENT  IN  COOPERATION 

R.  H.  Lane 
Assistant  Superintendent  of  Schools,  Los  Angeles,  California 

The  following  notice  appeared  in  the  Los  Angeles,  California 
School  Journal  for  January  20,  1919: 

The  Division  of  Educational  Research  has  in  mind  for  the  near  future 
the  development  of  a  plan  for  the  Self -Survey  of  the  Elementary  School  by 
the  Principal  and  his  Associate  teachers.  This  will  be  accomplished  partly 
by  means  of  standard  and  other  tests,  partly  by  an  investigation  along  uni- 
form lines  into  several  phases  of  the  administration  and  organization  of  the 
school.  It  is  a  matter  of  great  gratification  to  the  members  of  this  Division 
that  the  courses  along  this  Une  at  the  State  Normal  School,  have  been  so  well 
attended,  showing  that  the  time  is  ripe  for  an  enterprise  of  this  kind. 

It  must  be  obvious  that  such  a  scheme  can  be  successfully  worked  out 
only  through  the  cooperation  of  those  principals  who  wish  to  undertake  the 
work.  All  principals  who  are  interested  are  asked  to  communicate  at  once 
with  the  Director,  stating  that  they  will  be  willing  to  take  the  time  during 
the  spring  term  to  give  certain  tests  and  undertake  certain  studies  into  the 
organization  and  administration  of  their  schools.  This  will  necessitate  a 
few  meetings  in  the  near  future,  but  every  effort  will  be  made  to  avoid  taking 
an  undue  amount  of  the  principals'  time.  It  is  suggested  that  not  more 
than  twenty  principals  form  the  first  group  to  undertake  this  work. 

In  spite  of  the  restriction  placed  upon  the  number  of  members, 
the  class  which  began  work  in  February  was  made  up  of  twenty- 
eight  elementary  school  principals,  representing  all  types  of 
schools  from  the  large  well-graded  city  school  in  the  metropolitan 
district  to  the  small  ungraded  rural  school.  As  a  check  upon 
the  accuracy  of  the  methods  employed  by  members  of  the  class, 
the  director  carried  on  the  work  outlined  for  members  of  the 
class  simultaneously  in  five  other  elementary  schools,  whose 
principals  and  teachers  contributed  largely  to  the  success  of  this 
enterprise  by  their  hearty  cooperation. 

The  members  of  the  class  were  given,  in  addition  to  the  pre- 
liminary instructions  for  giving  the  first  tests,  some  general 
advice  as  to  the  spirit  in  which  the  enterprise  was  to  be  carried 
out,  in  something  like  the  following  vein: 
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Before  embarking  on  this  enterprise  the  principal  should  endeavor  to 
secure  to  the  fullest  possible  degree  the  interest  and  cooperation  of  his 
teachers.  The  tests  should  not  be  suddenly  sprung  upon  the  teachers  with- 
out warning,  but  every  eflfort  should  be  made  to  prepare  careful !y  and  gradu- 
ally the  plans  for  the  campaign.  It  is  inevitable  that  teachers  unfamiliar 
with  educational  measurement  should  look  upon  a  series  of  tests  as  an 
attempt  to  uncover  the  weak  spots  in  their  teaching  and  the  principal  must 
see  to  it  that  his  teachers  cultivate  that  fine  impersonal  attitude  which 
welcomes  measurement  as  a  possible  solution  of  certain  vexed  classroom 
problems.  He  should  emphasize  the  fact  that  one  of  the  greatest  contribu- 
tions of  educational  psychology  is  its  insistence  on  the  complexity  of  the 
learning  process,  that  a  child's  success  or  failure  in  his  school  work  is  the 
product  of  many  factors  of  which  the  quality  of  teaching  is  only  one  factor, 
and  that  a  teacher  must  not  charge  herself  with  the  failure  of  a  pupil  until 
she  has  eliminated  all  other  possible  factors  from  the  situation.  The  reputa- 
tion of  a  successful  teacher  should  be  such  an  assured  fact  both  in  her  own 
mind  and  that  of  her  fellow  teachers,  that  the  failure  of  a  class  in  any  test  or 
series  of  tests  should  not  even  suggest  that  the  teacher  is  personally  to  blame 
for  the  result.  The  finest  quality  which  a  teacher  can  possess  is  that  scientific 
habit  of  mind  which  welcomes  occasional  class  or  individual  failure  as  a 
challenge  to  her  powers  of  analysis,  and  interpretation. 

Some  very  definite  directions  were  given  as  to  the  preliminary 
reading  each  member  of  the  class  was  to  do.  Reference  was  made 
to  the  standard  books  on  educational  measurement  by  Thorndike, 
Monroe,  Rugg,  and  Alexander;  to  the  monographs  of  the  Uni- 
versity of  Chicago,  and  to  such  bulletins  as  those  prepared  by  the 
University  of  Illinois,  the  city  of  Boston,  the  Kansas  State 
Normal  School,  and  Teachers'  College,  Columbia  University. 

After  the  first  test  had  been  given  by  members  of  the  class  in 
their  respective  schools,  the  class  was  called  together  again  for 
discussion  upon  the  problems  which  arose  in  the  conduct  of  the 
work.  One  of  the  chief  problems  was  for  the  novice  to  learn  the 
technic  of  educational  statistics.  In  many  cases  individual 
help  as  well  as  class  help  became  necessary.  Reference  was  made 
to  the  excellent  chapters  in  Rugg's  Statistical  Methods  Applied  to 
Education}  Finally  it  became  necessary  to  send  out  some  brief 
lessons  in  mimeographed  form  upon  the  meaning  and  method  of 
finding  the  median,  mean,  mode,  etc. 

Seven  distinct  tests  in  arithmetic,  three  tests  in  reading,  the 
Trabue  scale  in  language,  and  selections  from  the  Hahn-Lackey 
scale  in  geography  comprised  the  material  used  during  the  term. 

'  Rugg,  H.  O.  Statistical  methods  applied  to  education.  Boston :  Houghton 
Mifflin  Co.,  1917. 
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An  effort  was  made  to  keep  constantly  before  the  class  the  need 
for  intelligent  interpretation  of  the  results  in  each  test.  It  may 
be  safely  laid  down  as  a  general  rule  that  any  test  which  does  not 
lead  to  definite  improvement  in  the  progress  of  pupils  is  a  test 
which  is  not  worth  giving.  It  is  true  that  having  found  the 
"average"  or  central  tendency  of  a  class  in  some  performance  the 
principal  is  possessed  of  information  which  justifies  him  in  saying 
that  a  particular  class  in  a  particular  performance  reached,  ex- 
ceeded, or  fell  below  the  accepted  standard  in  such  case  made  and 
provided,  but  the  classroom  teacher  will  not  derive  much  help 
thereby.  In  any  test  four  steps  should  be  recognized:  (1)  The 
test  gives  us  the  facts  in  the  case;  (2)  It  shows  which  pupils  are 
failing  in  that  phase  of  instruction  covered  by  the  test.  Hence  if 
the  test  is  to  function :  (3)  The  reason  for  those  individual  failures 
must  be  found ;  (4)  Remedial  measures  must  be  taken  to  correct 
those  failures. 

For  a  full  treatment  of  this  subject  of  interpretation  see 
Dr.  Monroe's  Measuring  the  Results  of  Teaching.^  In  addition, 
the  results  from  experiments  in  the  control  schools  along  this  line 
will  be  found  illuminating. 

One  of  the  fifth-grade  classes  tested  early  in  March,  attained 
a  median  in  the  Quick  Test  in  Arithmetic'  of  2.5  problems  correct 
in  six  minutes,  an  obviously  unsatisfactory  result.  The  common 
prescription  of  the  classroom  teacher  in  such  cases  is  ''more 
drill,"  but  it  was  pointed  out  that  more  drill  would  be  ineffective 
unless  the  cause  for  each  individual  failure  was  located.  This 
was  done  and  the  following  instances  of  failure  noted. 

1.  In  addition  several  children  knew  single  combinations  per- 
fectly, i.e.,  6  plus  7,  but  failed  on  similar  combinations  when 
extended  into  decades,  i.e.,  36  plus  7,  47  plus  (i,  etc. 

2.  In  addition  of  four  columns  children  had  not  been  taught 
to  place  the  "carrying  figure"  above  or  below  successive  columns, 
hence  if  their  attention  wavered  slightly,  the  carrying  figure  was 
forgotten  and  the  addition  had  to  be  gone  over  from  the  beginning. 

3.  In  long  division  many  children  did  not  know  how  to  find 
the  first  figure  of  the  quotient. 

*  Monroe,  Walter  S.  Measuring  the  results  of  teaching.  Boston:  Houghton 
Mifflin  Co.,  1918. 

'  Second  year  hook  of  the  Division  of  Educational  Research,  Los  Angeles,  California, 
1919  (Los  Angeles  City  School  District  No.  21)  p.  3. 
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4.  In  the  following  problem  a  girl  worked  as  follows: 

4 

36)16236 
144 

She  then  asked  the  observer  if  one  added  or  subtracted  144 
to  or  from  162! 

By  means  of  diagnosis  of  this  kind  and  very  intelligent  "follow 
up"  work  by  the  teacher,  the  class  in  June  attained  a  median  of 
5.2  problems  correct,  an  improvement  of  over  100  percent. 

In  another  control  school  several  children  were  located  who 
were  very  poor  in  oral  reading  with  respect  both  to  speed  and 
accuracy.  Careful  records  were  made  of  these  children  by  means 
of  Gray's  Oral  Reading  Test  (Standardized  Paragraphs)  and 
individual  attention  was  paid  to  each  child  by  his  teacher  with 
a  view  to  eliminating  sources  of  difficulty.  At  that  time,  the 
writer  made  the  following  recommendations  to  the  teachers. 

TO'  THE   TEACHER 

I  present  herewith  an  accurate  record  of  the  scores  of  those  children  who 
had  unusual  difl&culty  in  their  oral  reading  tests.  Let  us  repeat  the  test  in 
June  to  note  improvement.  Failure  in  oral  reading  is  due  to  one  or  all  of 
the  following  causes:  (a)  Deficient  vocabulary,  i.e.,  lack  of  a  sufficiently  large 
number  of  words  which  the  pupil  is  able  to  recognize  at  sight;  (b)  lack 
of  phonic  power  to  analyze  unfamiliar  words;  (c)  lack  of  ability  to  move  the 
eye  along  swiftly  enough  to  catch  the  text  in  large  units  or  phrases — "eye 
sweep";  (d)  faulty  or  slovenly  enunciation;  (e)  unfamiliarity  in  the  middle 
grades  with  the  derivation  of  words,  i.e.,  word  analysis;  (f)  lack  of  adequate 
material  for  rapid  oral  reading,  i.e.,  easy  supplementary  readers. 

I  therefore  recommend  exercises  as  follows: 

(a)  Vocabulary  drills  to  enlarge  the  vocabulary  of  sight  words. 

(b)  Phonic  drills  to  give  power  over  unfamiliar  words  (see  Gordon  and 
Beacon  Manuals). 

(c)  Word  analysis  drills  (see  Horace  Mann  Readers). 

(d)  Frequent  time  exercises  in  oral  reading  to  cultivate  rapidity. 

(e)  Enunciation  drills. 

A  repetition  of  the  test  in  June  showed  marked  improvement. 

A  word  of  caution  must  be  given  to  the  principal  who  gives  a 
test  and  finds  the  result  below  standard.  The  obvious  explanation 
is  that  the  teacher  of  the  class  is  a  poor  teacher,  but  one  soon 
learns  to  distrust  this  easy  and  obvious  explanation.  In  one  of 
the  control  schools  several  primary  classes  failed  in  a  simple  read- 
ing test.     The  personnel  of  the  teaching  force  was  of  so  high  a 
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character  that  the  factor  of  poor  teaching  was  quickly  eliminated 
from  the  situation.  After  a  careful  investigation  by  the  principal 
the  following  reasons  for  the  failure  were  found: 

1 .  The  pupils  in  the  failing  classes  had  been  victims  of  half-day 
sessions  for  several  terms. 

2.  The  pupils  had  had  a  succession  of  teachers  in  the  preceding 
terms,  one  class  alone  having  had  seven  different  teachers  in  the 
ten  months  of  school. 

3.  There  had  been  several  classes  in  each  room  at  a  time, 
i.e.,  B2,  A2,  B3,  A3,  with  the  result  that  in  the  effort  to  care  for 
all  four  classes  the  amount  of  time  available  to  the  teacher  for 
individual  instruction  was  practically  nil. 

4.  The  teachers  had  not  had  clearly  in  mind  what  constitutes 
desirable  standards  of  promotion  from  one  class  to  another,  with 
the  result  that  the  classes  were  poorly  graded. 

5.  Each  class  had  a  relatively  large  number  of  mentally 
defective  children  who  were  incapable  of  profiting  by  classroom 
instruction  in  large  groups. 

At  the  opening  of  the  fall  term  1919,  principals  were  invited 
to  join  new  Self-Survey  Classes  along  the  lines  described  above. 
Twenty-two  of  the  original  twenty-eight  principals  registered  for 
membership  in  an  advanced  class,  while  fifty-four  other  principals 
registered  for  elementary  classes,  necessitating  the  formation  of 
four  sections  in  the  Self-Survey  Class,  three  for  beginners  and  one 
for  advanced  students.  The  work  of  the  beginners  for  1919-1920 
will  be  to  cover  the  better  known  educational  tests,  while  the 
advanced  pupils  will  study  especially  group  intelligence  tests. 

Considerable  attention  has  already  been  given  to  the  Group 
Point  Scale  of  Intelligence  "Schedule  D"  devised  by  Dr.  and 
Mrs.  Pressey  of  Indiana  University.*  This  is  being  given  to  a 
large  number  of  A6  classes  with  some  very  interesting  results. 
Later  on,  it  is  planned  to  experiment  with  the  Otis  Group  Tests 
in  eighth-grade  classes.  The  advanced  section  of  the  Self-Survey 
Class  will  experiment  also  with  Dr.  Strayer's  Score  Card  for  City 
School  Buildings.  Los  Angeles  has  many  types  of  school  build- 
ings, and  it  is  beheved  that  an  intensive  study  of  the  construction 
of  these  will  result  in  an  awakened  interest  in  better  buildings. 

*  Pressey,  S.  L.  and  L.  W.     "A  group  point  scale  of  intelligence,"  Journal  of 
Applied  Psychology,  2:250-69,  September,  1918.      The  test  may  be  purchased  from 
ndiana  University,  Bloomington,  Indiana. 


ANALYSIS  OF  AND  TESTING  IN  COMMON  FRACTIONS 

Arthur  W.  Kallom 
Department  of  Educational  Investigation   and  Measurement,   Boston,   Massachusetts 

In  spite  of  all  that  has  been  written  in  regard  to  simplicity 
of  work  in  common  fractions,  the  latest  books  still  continue  to 
give  examples  involving  large  denominators  and,  in  the  operat'ons 
of  addition  and  subtraction,  continue  to  use  fractions  which 
involve  a  common  denominator  so  large  that  the  pupils  cannot 
use  it  to  advantage. 

In  Boston,  by  the  terms  of  the  new  course  of  study,  teachers 
have  been  asked  to  restrict  their  work  with  fractions  to  those 
having  a  denominator  not  larger  than  sixteen  and  a  common  de- 
nominator not  larger  than  one  hundred,  and  to  eliminate  all 
unusual  fractions,  such  as  elevenths  and  thirteenths.  This  was 
later  emphasized  by  a  test  in  the  four  operations  prepared  by 
the  Department  of  Educational  Investigation  and  Measurement. 

Organization  of  Work  in  Fractions 
Organized  work  in  the  study  of  common  fractions  was  insti- 
tuted in  Boston  in  December  of  1914  by  the  appointment  of  a 
committee  of  teachers  and  masters.  This  committee  cooperated 
with  the  Department  of  Educational  Investigation  and  Measure- 
ment of  the  city  in  the  hope  of  organizing  a  standardized  test  in 
the  four  operations  in  fractions.  Several  months  were  devoted  to 
the  problem,  most  of  the  time  being  consumed  in  the  study  of 
addition  and  subtraction.  In  its  study  the  committee  distin- 
guished fourteen  distinct  types  of  examples  in  addition  and  seven 
in  subtraction.  The  following  analysis  will  show  that  the  classi- 
fication into  the  fourteen  types  in  addition  is  based  on  two  factors, 
the  common  denominator  and  the  form  of  the  answer. 

Analysis  of  Type  Examples  in  Addition  of  Two  Fractions 

Groups  of  two  or  more  fractions  may  be  divided  into  two 

classes,  similar  and  dissimilar.     Similar  fractions  are  defined  as 

fract  ons   having   the   same   denominator.     Dissimilar  fractions 

are  those  which  have  difi"erent  denominators.     Each  one  of  these 
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classes  may  be  further  subdivided  according  to  whether  the  result 
obtained  from  adding  is  non-reducible  or  reducible.  If  the  result 
is  non-reducible,  the  answer  is  in  an  acceptable  form  after  the 
numerators  of  the  similar  fractions  have  been  added.  If  the 
result  is  reducible,  it  may  be  changed  to  a  mixed  number,  to 
lowest  terms,  or  to  both,  before  the  answer  can  be  said  to  be  in  an 
acceptable  form.  A  discussion  of  the  fourteen  types  is  given 
here  because  it  is  believed  that  the  recognition  of  them  will  be 
hejpful  to  teachers  in  instructing  children  in  the  addition  of 
fractions.  The  reader  should  bear  in  mind  that  these  types 
occur  in  the  addition  of  two  fractions  and  that  the  addition  of 
two  m  xed  numbers  or  a  mixed  number  and  a  fraction  probably 
creates  other  types  as  do  examples  having  three  or  more  addends. 

A.     S'milar  Fractions 
Four  types  are  all  that  are  possible  when  fractions  are  similar. 
Type  1. — After  adding,  the  result  is  non-reducible. 

For  example:     ^     .     ~ 

Type  2. — After  adding,  the  result  is  reducible  either  to  an 
integer  or  to  a  mixed  number. 

For  example:     ^     .     o       * 

7^7     7       7 

Type  3. — After  adding,  the  result  is  reducible  to  lowest  terms. 

For  example:     c     i     <     9 
9+9=9=3 

Type  4. — After  adding,  the  result  is  reducible  both  to  lowest 
terms  and  to  a  mixed  number. 

For  example:    ^     5_10^5^  2 

B.     Dissimilar  Fractions 
Under  the  heading  of  dissimilar  fractions   there  are  three 
divisions  depending  on  the  common  denominator. 

a)  When  the  least  common  denominator  is  the  denominator 
of  one  of  the  fractions. 

b)  When  the  least  common  denominator  is  the  product  of 
the  denom  nators. 
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c)  When  the  least  common  denominator  is  found  by  factoring. 
These  will  be  considered  in  order. 

a)  When  the  least  common  denominator  is  the  denominator 
of  one  of  the  fractions,  there  are  four  types,  one  non-reducible  and 
three  reducible,  similar  to  the  preceding  four  types. 

Type  5. — The  denominator  of  one  of  the  fractions  is  the  least 
common  denominator.     After  adding,  the  result  is  non-reducible. 
For  example:     .     ,     ,, 

Type  6. — The  denominator  of  one  of  the  fractions  is  the  least 
common  denominator.  After  adding,  the  result  is  reducible  to 
a  mixed  number. 

For  example:     o     7      11        1 
5  "'"10  "To  "^10 

Type  7. — The  denominator  of  one  of  the  fractions  is  the  least 
common  denominator.  After  adding,  the  result  is  reducible  to 
lowest  terms. 

For  example:     1^04 
2"'"l0"l0"5 

Type  8. — The  denominator  of  one  of  the  fractions  is  the  least 
common  denominator.  After  adding,  the  result  is  reducible  to 
lowest  terms  and  to  a  mixed  number. 

For  example:     ^      c      14.    7       i 
4"'"12"T2"'6"'^6 

b)  When  the  least  common  denominator  is  the  product  of 
the  denominators,  there  are  only  two  types,  one  non-reducible 
and  the  other  reducible  to  a  mixed  number.  After  reducing 
fractions  of  these  two  types  to  similar  fractions  and  adding  the 
numerators,  the  result  is  always  a  fraction  in  which  the  numerator 
and  denominator  are  prime  to  each  other.  This  makes  it  impos- 
sible to  obtain  a  result  which  can  be  reduced  to  lowest  terms. 

Type  9. — The  denominators  are  prime  to  each  other,  hence 
the  common  denominator  must  be  the  product  of  the  denomina- 
tors.    After  adding,  the  result  is  non-reducible. 


For  example:     ^     ~     ^- 


5"'"8    40 
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Type  10. — The  denominators  are  prime  to  each  other,  hence 
the  common  denominator  must  be  the  product  of  the  denomina- 
tors.    After  adding,  the  result  is  reducible  to  a  mixed  number. 

For  example:     -j     i     -i-j       i 

c)  When  the  least  common  denominator  is  found  by  factor- 
ing, there  are  four  types,  one  non-reducible  and  three  reducible. 

Type  11. — The  least  common  denominator  is  found  by  factor- 
ing.    After  adding  the  result  is  non-reducible. 
For  example:     107 

Type  12. — The  least  common  denominator  is  found  by  fac- 
toring.    After  adding,  the  result  is  reducible  to  a  mixed  number. 
For  example:     1     c     i-i       -i 
4'^6"l2"^12 

Type  13. — The  least  common  denominator  is  found  by  factor- 
ing.    After  adding,  the  result  is  reducible  to  lowest  terms. 
For  example:     \      7      q      t. 
6'''l5"30~l6 

Type  14. — The  least  common  denominator  is  found  by  factor- 
ing. After  adding,  the  result  is  reducible  to  lowest  terms  and 
to  a  mixed  number. 

For  example:     ^     9^_32_16_  _1_ 

Analysis  of  Type  Examples  in  Subtraction  of  Fractions 

There  are  seven  distinct  types  when  one  fraction  is  subtracted 
from  another.  Owing  to  lack  of  space  the  analysis  for  subtraction 
of  fractions  is  not  given,  but  it  is  on  the  same  basis  as  has  been 
shown  in  addition  of  fractions.  The  reason  for  the  smaller  num- 
ber of  types  is  because  of  the  impossibility  of  subtracting  one 
fraction  from  another  and  obtaining  an  integer  or  mixed  number 
for  an  answer.  Thus  there  are  no  subtraction  types  analogous  to 
T5T)es  2,  4,  6,  8,  10,  12,  and  14  in  addition.  Besides  the  seven 
types  there  are,  of  course,  the  subtraction  of  a  mixed  number 
rom  a  whole  number  or  a  mixed  number  from  a  mixed  number. 
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Analysis  of  Types  in  Multiplication  and 
Division  of  Fractions 

When  the  committee  approached  the  study  of  multiplication 
and  division  of  fractions,  they  did  not  deem  it  wise  to  make  so 
extended  an  analysis.  In  these  two  processes  the  separation 
into  types  depended  upon  the  character  of  the  multiplier  and 
multiplicand  or  the  dividend  and  divisor.  Reducible  and  non- 
reducible cases  were  not  distinguished.  The  analysis  of  multi- 
plication was  as  follows: 
Multiplication  of: 

Fraction  by  a  whole  number 

Mixed  number  by  a  whole  number 

Whole  number  by  a  fraction 

Whole  number  by  a  mixed  number 

Fraction  by  a  fraction 

Mixed  number  by  a  fraction 

Mixed  number  by  a  mixed  number 
The  multiplication  of  a  fraction  by  a  mixed  number  was  not 
included  because  there  is  little  or  no  use  for  it  in  adult  practice. 
In  division  of  fractions  the  process  is  either  one  of  two  pro- 
cedures. In  the  first  case,  one  proceeds  to  find  how  many  times 
one  number  of  a  certain  denomination  is  contained  in  a  larger 
number  of  the  same  denomination.  That  is,  this  process  is  to 
determine  how  many  measures  of  a  certain  size  there  are  in  a 
measure  of  a  different  size.  This  type  of  procedure  has  been  called 
division  hy  measuring.  In  the  second  case,  one  proceeds  to 
separate  a  number  into  a  certain  number  of  parts  and  to  find  out 
the  size  of  each  part.  This  type  of  division  is  called  division  hy 
parting.  These  two  cases,  measuring  and  parting,  became  the 
basis  upon  which  the  analysis  in  division  of  fractions  was  made. 
In  view  of  these  conditions,  the  following  types  were  selected. 
Division  of: 

Fraction  by  a  whole  number  (parting) 
Mixed  number  by  a  whole  number  (parting) 
Whole  number  by  a  fraction  (measuring) 
Whole  number  by  a  mixed  number  (measuring) 
Fraction  by  a  fraction  (either) 
Mixed  number  by  a  fraction  (measuring) 
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Preliminary  Work 
A  part  of  the  preliminary  work  of  the  teacher  committee, 
prior  to  any  testing,  consisted  in  devising  a  diagnostic  sheet  in 
addition  for  the  use  of  the  teachers.  It  consisted  of  12  examples, 
one  each  of  Types  3  to  14  inclusive.  This  sheet  of  12  examples 
was  called  a  form.  In  order  to  give  the  teacher  plenty  of  material 
to  work  with,  ten  different  forms  were  organized.  Figure  1 
represents  Form  1. 


Score 


rRE    1 

.      DIAGNOSTIC     1 

SHEET 

FOR     ADDITION 

OF     FRACTIONS 

FORM  1 

.Time.... 

Name 

(A) 

3 

(B) 

5 

(C) 

2 

(D)     3 

16 

6 

3 

4 

7 
16 

5 
6 

4 
15 

7 
8 

(E) 

1 
2 

(F) 

6 
7 

(G) 

2 
9 

(H)     1 
4 

3 
10 

9 
14 

J 

7 
10 

8 
9 

(I) 

3 

i 

(J) 

7 
9 

(K) 

1 
6 

(L)     5 
6 

7 
12 

8 
15 

7 
10 

3 
14 

The  letters  at  the  left  of  each  example  indicate  the  type  to 
which  the  example  belongs.  The  first  example  on  the  sheet 
lettered  "A"  represents  Type  3,  "B"  represents  Type  4,  "C" 
represents  Type  5,  etc.  On  account  of  their  simpHcity,  Types  1 
and  2  were  omitted  from  these  forms. 

In  using  the  forms  the  teacher  gives  each  pupil  a  sheet  on 
which  is  printed  these  twelve  examples,  or  twelve  others  similar 
to  those  represented  in  Figure  1,  and  requests  him  to  do  the 
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examples  as  quickly  and  accurately  as  possible,  placing  the  answer 
on  the  sheet.  After  all  the  children  have  finished,  the  work  may 
be  corrected  by  the  pupil  or  by  the  teacher.  A  record  of  incorrect 
examples  may  be  kept  on  a  sheet  such  as  the  one  represented  by 
figure  2. 

FIGURE  2.      SCORE  SHEET  FOR  KEEPING  THE  RECORD  OF  A  PUPIL 
IN  THE  ADDITION  OF  TWO  FRACTIONS 


Name 

....Grade... 

. . .  Room . . . 

Examples 

Form 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

A 

B 

C 

D 

E 

F 

G 

H 

I 

J 

K 

L 

Score 

Time 
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This  sheet  may  be  used  to  preserve  the  record  of  each  pupil's 
work.  The  letters  in  the  first  vertical  column  correspond  to  the 
letters  on  Form  1  (p.  182).  After  correcting  the  examples  of  this 
form,  the  teacher  or  pupil  records  the  results  in  the  column 
devoted  to  Form  1.  Those  pupils  having  a  perfect  score  need  not 
waste  their  time  taking  any  further  forms.  Those  having  wrong 
work  should  be  given  necessary  help  on  the  type  or  types  in  which 
they  failed:  and  after  some  drill,  they  may  take  a  second  test 
represented  by  the  second  form.  The  results  are  recorded  in  the 
column  headed  "Form  2,"  and  so  on.  The  teacher  thus  has  a 
continuous  record  of  each  pupil.  By  means  of  this  record  a 
diagnosis  of  the  pupil's  difficulties  is  provided.  Effort  may  be 
concentrated  where  it  is  needed. 

Figure  3  shows  the  record  of  a  girl,  M.  F.,  in  grade  v.  A 
check  mark  indicates  that  an  example  was  right,  a  cross  that 
an  example  was  wrong.  The  first  column  shows  her  resu  t  on 
Form  1.  In  the  succeeding  vertical  columns  is  indicated  her 
results  on  Forms  2,  3,  4,  etc.  For  example,  in  Form  1,  M.  F. 
failed  in  every  type  except  Type  3  (A).  She  received  individual 
help  and  a  few  days  later  attempted  Form  2,  composed  of  exam- 
ples similar  to  those  of  Form  1.  M,  F.  was  then  able  to  do  all 
but  Types  8  (F),  9  (G),  13  (K),  and  14  (L). 

After  each  form  is  offered  corrective  material  is  given,  laying 
stress  upon  the  type  in  which  the  individual  has  failed.  Figure  3 
shows  that  in  succeeding  tests,  although  M.  F.  fails  in  various 
types,  Type  9  (G)  persists  as  a  "trouble  maker"  until  the  seventh 
form  has  been  given.  Type  13  (K)  is  solved  correctly  on  the 
fourth  form,  but  not  again  until  the  tenth  form;  while  Type  14  (L) 
is  solved  correctly  for  the  first  time  at  the  sixth  trial. 

Even  the  ten  trials,  however,  are  not  enough  to  fix  these  two 
types.  Type  12  (J)  is  "in  and  out."  Of  course,  only  the  papers 
themselves  show  the  trouble  in  complete  detail,  but  this  kind  of 
sheet  makes  a  permanent  record  which  is  very  valuable  to  both 
pupil  and  teacher.  This  pupil  has  made  a  gain,  for  she  has  not 
only  been  able  to  get  the  examples  of  each  type  right  at  least 
once,  but  she  has  aiso  been  able  to  decrease  her  time  from  nine 
minutes  to  five,  as  indicated  on  the  lowest  horizontal  line. 

Thus,  the  teacher  is  able  by  such  a  selected  group  of  examples, 
to  diagnose  the  difficulties  of  her  pupils  in  addition  of  fractions. 
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FIGURE  3.      RECORD  OF  M.  F.  IN  ADDITION  OF  FRACTION 

Name  M .     F .  Grade  V  Room   156 
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X 

V 

X 

V 
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K 
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V 

X 
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X 

X 

X 

X 

X 

V 
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1 

8 

6 

8 

8 

7 

6 

8 

8 

11 

Time 

9 

10 

8 

13 

13 

16 

8 

8 

8 

5 

Children  are  growing  more  and  more  interested  in  drawing 
graphs  of  their  work.  This  task  is  simple  and  comparatively 
easy  when  cross-section  paper  is  used.  For  this  work  in  addition, 
two  lines  are  drawn  at  right  angles  to  each  other  and  each  twelve 
spaces  long  (Figures  4-9).     Just  below  the  horizontal  line  are 
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placed  the  twelve  letters  indicating  the  types  of  examples,  one 
in  a  square.  Along  the  vertical  line  are  shown  the  percents  of 
the  total  test,  ranging  from  0  to  100. 

If  the  example  A  is  right,  a  short  line  is  drawn  from  the  zero 
point  diagonally  upward  across  the  square  above  A.     For  each 
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additional  correct  example  a  short  line  is  similarly  drawn  above 
the  type  letter  making  a  continuous  curve.  In  this  way,  if  all 
example-  are  right,  the  curve  will  be  a  straight  line  at  an  angle  of 
45  dcLiees  to  the  horizontal.  If  an  example  is  wrong  a  short 
horizontal  line  connected  with  the  previous  part  of  the  curve  is 
drawn  along  the  base  of  the  appropriate  square.  Thus  the  con- 
tinuous curve  will  receive  no  elevation  for  an  incorrect  example. 

Figures  4  to  9  inclusive  show  graphically  the  performance  of 
M.  F.  on  Forms  1,  2,  3,  4,  6,  and  10  respectively  (see  Figure  3). 
Observe  that  the  end  of  the  curve,  when  completed,  automatically 
indicates  the  percent  of  accuracy  for  the  form  to  which  the  curve 
applies.  Thus  in  the  case  of  M.  F.,  Figure  4  shows  that  the  score 
on  Form  1  was  8  1/3  percent.  According  to  Figure  5,  her  score 
on  Form  2  was  66  2/3  percent.  Figure  9  shows  a  percent  of 
91  2/3  for  Form  10. 

The  shape  of  the  curve  also  indicates,  in  some  measure,  the 
way  the  pupil  learns.  The  interest  of  the  pupil  is  held  in  attempt- 
ing to  make  a  straight  line.  The  plan,  therefore,  becomes  a  real 
means  of  motivating  the  work. 

These  two  methods  of  keeping  a  record  enable  the  teacher  to 
determine  at  once  where  the  pupil  is  having  difficulty,  and  it  must 
be  remembered  that  a  pupil's  ability  to  add  fractions  is  no  greater 
than  his  ability  in  each  one  of  these  fourteen  types.  Such 
records  indicate  that  a  pupil  may  be  able  to  do  the  simpler  types 
without  being  able  to  do  the  more  complicated  ones — e.g..  Types 
13  and  14.  In  other  words,  the  general  knowledge  that  a  pupil 
can  or  cannot  add  fractions  is  not  sufficient.  On  that  basis  no 
teacher  can  accurately  diagnose  difficulties  or  intelligently  apply 
remedies.  It  is  only  when  the  teacher  takes  the  various  possi- 
bilities— possibilities  such  as  this  analysis  of  operations  in  adding 
fractions  supplies — and  tests  the  children  with  all  of  these  that 
she  is  able  to  determine  whether  each  pupil  will  probably  be  able 
to  add  any  example  in  fractions  with  which  he  may  be  confronted. 

Monroe  directs  attention  to  this  same  fact  when  he  calls  "the 
situation  which  the  teacher  faces  a  complex  one."  He  adds  that: 
"Before  she  can  intelligently  direct  her  efforts  as  an  instructor  she 
must  diagnose  the  situation."^  This  may  be  done  only  by  taking 
all  the  possibilities  into  consideration. 

^  Monroe,  Walter  S.  and  De  Voss,  J.  C  and  Kelly,  F.  J.  Educalional  tests  atid 
measurements.     Boston:  Houghton  MiDBin  Co.,  1917,  p.  49. 
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Results  of  Preliminary  Work 

Forms  similar  to  those  in  Figure  1  (page  182)  were  used  in  the 
fifth  grades  of  five  districts  in  Boston  in  the  spring  of  1915.  The 
results  of  this  testing,  as  sent  to  the  office  of  the  department, 
showed  that  in  general  the  accuracy  increased  and  the  time 
necessary  to  do  the  examples  shortened  as  the  children  worked 
each  successive  form.  In  addition  to  this,  the  data  gathered 
from  this  material  showed: 

a)  That  testing  of  this  kind  would  be  Hkely  to  produce  results 
which  would  show  the  ability  of  children  to  add  fractions. 

b)  That  children  might  be  able  to  do  non-reducible  types  but 
would  have  trouble  in  doing  types  where  reduction  was 
necessary. 

c)  That  the  time  required  to  do  the  twelve  examples  on  each 
form  varied  greatly.  The  shortest  time  recorded  by  an 
individual  was  two  minutes  and  the  longest  forty-one 
minutes. 

Similar  forms  are  now  being  printed  for  use  in  subtraction, 
multiplication,  and  division  of  fractions. 

Suggestions  for  Diagnosis 

It  has  been  pointed  out  in  the  foregoing  that  satisfactory 
diagnosis  can  be  carried  on  only  when  all  types  are  represented. 
The  knowledge  that  a  pupil  can  multiply  456  1/3  by  2  is  not 
sufficient,  because  the  example  is  so  constructed  that  it  does  not 
bring  in  all  the  elements  of  a  mixed  number  multiplied  by  an 
integer.  A  pupil  may  do  this  type  without  being  able  to  do  a 
similar  example  when  the  product  of  the  fraction  by  the  integer 
is  equal  to  or  more  than  a  whole  number. 

What  is  meant,  then,  by  diagnosis?  By  diagnosis  is  meant 
noting  certain  existing  symptoms  and  finding  out  from  them  what 
is  the  trouble.  This  is  usually  done  by  correcting  the  pupil's 
examples.  Each  pupil  may  have  a  different  trouble  and,  there- 
fore, require  a  different  treatment.  Thus  the  importance  of  the 
individual  is  brought  to  the  front.  There  may  be  two  reasons 
for  looking  over  a  set  of  papers:  (1)  simply  to  mark  examples 
right  or  wrong;  (2)  to  gain  some  knowledge  which  will  tend  to 
correct  pupil's  work.     Diagnosis  emphasizes  the  latter  reason. 
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There  are  four  principles  which  underiie  any  diagnosis  of  the 
results  of  a  test  aside  from  the  necessity  of  having  all  types  of 
examples  represented. 

a)  Trouble  with  individual  pupils  cannot  be  discovered  by 
studying  and  emphasizing  the  work  of  the  children  who  have 
examples  right.  The  principle  that  success  comes  through  failure 
must  be  practiced  here,  and  the  teacher  will  find  her  richest 
material  for  study  in  the  poorest  papers. 

b)  After  selecting  the  papers  with  low  scores  it  is  necessary  to 
find  out  from  each  paper,  if  possible,  how  the  pupil  did  his  work. 
The  fact  that  a  pupil  usually  does  each  type  of  example  in  the 
same  way  makes  this  possible  in  a  large  number  of  cases.  In 
many  cases,  however,  it  is  not  possible  to  determine  how  the 
work  is  done  because  of  the  queer  methods  used  by  different 
individuals.  The  following  are  a  few  of  the  methods  used  by 
pupils  in  a  test  given  in  December,  1917: 

i\)    Z75  iz)    ^yQ^YQ^^vVi 

^  4^ 

Z6  =4x5  +  3  1/ 

ZZ0Z5  '  7     =%x^  =  %K9f=^  =  7 

TW 

Vs     ^ZO     i.ZO) 

13 
207375 

(5)      J^k6-64 
5^x6  = 

4   (6x6;  64 

3JT9Z 

All  the  methods  illustrated  above,  with  many  others,  show 
the  almost  unbelievable  ways  used  by  children  even  though  they 
have,  been  taught  proper  methods.  If  an  examination  of  the 
paper  fails  to  show  how  the  work  was  done,  then  a  session  with 
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the  pupil  is,  of  course,  necessary.  What  is  essential  to  discover 
is  whether  the  pupil  has  anything  to  build  upon.  If  he  has  little 
except  a  collection  of  bad  habits,  then  there  is  a  long,  weary 
struggle  to  overcome  these  habits  and  estabHsh  habits  of  right 
thinking  and  right  action  before  results  can  be  obtained.  For  in 
the  last  analysis  accuracy  in  all  mechanical  work  depends  upon 
the  formation  of  right  habits  of  work. 

c)  The  nature  of  the  corrective  material  to  be  given  is  deter- 
mined by  the  results  of  the  study  of  the  papers  made  under  (a) 
and  (b).  To  try  to  determine  this  before  the  study  means 
wasted  time  for  both  teacher  and  pupil. 

d)  The  most  important  step  of  all  is  the  keeping  of  a  record 
of  each  pupil's  performance.  In  no  other  way  can  one  tell 
whether  the  pupil  is  advancing  or  not. 

Plan  of  Recording  Results 

As  a  result  of  this  study  of  common  fractions,  how  may  a 
teacher  effectively  check  the  work  in  her  grade?  How  may  she 
determine,  and  keep  in  some  permanent  form,  a  record  of  the 
pupils  ability  in  the  four  operations  in  common  fractions?  The 
accompanying  form  of  record  (Figure  10)  has  been  used  and  has 
proved  effective.  This  sheet  may  be  dupHcated  so  that  each 
pupil  may  have  a  copy.     It  was  planned  to  be  used  as  follows: 

The  teacher  may  give  examples  in  addition  similar  to  the 
types  illustrated  on  page  178  or  she  may  give  examples  of  the 
various  types  into  which  the  other  three  operations  have  been 
analyzed. 

If  the  pupils  get  the  answers  right,  the  appropriate  types  may 
be  checked  in  the  column  marked  "R,"  if  wrong  they  may  be 
checked  in  the  column  marked  "W."  The  checks  in  the  "wrong" 
column  should  be  changed  as  fast  as  the  pupil  has  mastered  the 
types,  or  a  separate  record  sheet  may  be  used  for  each  trial.  After 
giving  a  series  of  lessons  covering  the  various  types  and  recording 
results,  the  teacher  has  a  record  of  the  ability  of  each  individual 
in  the  room  showing  his  strength  and  weakness.  If  a  pupil  fails 
in  a  verbal  problem,  it  can  be  determined  immediately  by  refer- 
ence to  this  record  whether  or  not  the  difficulty  is  in  the  mechanics 
of  the  problem.  The  mechanics  may  be  wrong,  and  still  the 
pupil  may  have  shown  in  previous  work  that  he  knew  how  to  do 


i 


March,  1920  ANALYSIS  IN  FRACTIONS 

FIGURE  10.      RECORD  IN  COMMON  FRACTIONS  OF 
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the  type  of  mechanical  work  involved.  If  so,  the  teacher's  work 
should  be  quite  different  from  what  it  would  be  if  the  pupil  did 
not  know  the  mechanics  involved.  In  any  case,  the  important 
point  is  that  the  teacher  can  easily  tell  from  her  record  in  what 
way  and  to  what  extent  she  should  help  the  pupil. 

Conclusions 
I.     Modern   teaching   requires   an   analysis   of   conditions 
such  that  the  teacher  may  know  all  the  possibilities  in  the  subject 
under  discussion. 

II.  Knowledge  of  the  subject  demands  knowledge  of  all 
parts  of  the  subject  as  determined  by  the  analysis  which  has 
been  made. 

III.     Diagnosis  of  results  depends  upon  four  principles: 

1.  Study  the  papers  of  the  poorest  pupils. 

2.  Find  out  how  each  pupil  did  his  work. 

3.  Determine  from  this  the  kind  of  corrective  material 
to  be  given. 

4.  Keep  a  record  of  each  pupil's  performance. 
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To  encourage  an  intelligent  individualization  in  school  instruc- 
tion is,  to  the  writer's  mind,  the  most  pressing  duty  of  modern 
educational  supervision.  It  is  one  aspect,  and  that  a  decidedly 
technical  one,  of  the  whole  movement  toward  adapting  the  school 
to  the  individual.  The  general  problem  has  been  attacked 
administratively  in  reforms  relating  to  promotion,  grading,  the 
size  of  classes,  and  the  nature  and  extent  of  the  curriculum.  But 
in  the  teaching  process  there  have  been  few  evidences  of  an  appre- 
ciation of  the  problem.  Regardless  of  improved  grading,  reduced 
classes,  greater  flexibility  of  promotion,  and  the  like,  the  teaching 
technic  still  remains  largely  managerial  rather  than  tutorial. 
The  existence  of  individual  differences  is  readily  enough  admitted, 
but  they  are  rarely  defined  or  their  extent  calculated.  Their 
mplications  for  instruction  are  pretty  widely  ignored.  Alert 
isupervision  will  tend  to  change  this  situation;  will  challenge  the 
sanctity  of  the  eternal  test  recitation;  will  decry  uniform  assign- 
ments and  uniform  drill;  will  insist  on  analytical  marking;  will 
stimulate  teachers  and  pupils  alike  to  determine  individual  needs 
and  apply  individual  remedies. 

As  an  instrument  in  bringing  about  the  desired  change  in 
ms  ructional  emphasis,  the  standardized  test  is  helpful.  In  three 
ways,  at  least,  it  meets  initial  problems.  (1)  It  furnishes  concrete, 
intelligible  evidence  of  the  presence  and  extent  of  individual  differ- 
ences within  school  groups.  (2)  It  defines,  in  many  instances,  the 
exact  nature  of  the  differences  or  makes  such  definition  possible. 
(3)  It  permits  the  establishment  of  definite  standards  for  individual 
accomplishment  in  many  fundamental  phases  of  school  learning. 

Little  need  be  said  of  the  service  performed  by  standardized 
tests  in  revealing  the  variation  in  ability  within  school  groups. 
Throughout  the  now  abundant  literature  on  the  measurement  of 
achievement  in  school  subjects  a  foremost  place  has  been  given  to 
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the  phenomena  of  individual  differences  and  their  implications. 
It  has  been  stated  repeatedly  that  an  average  is  a  feeble  guide  for 
instruction  when  compared  with  a  distribution  table,  and  that  for 
the  teacher  the  most  important  data  from  these  tests  are  not 
averages,  or  medians,  or  other  records  of  central  tendencies,  but 
rather  the  individual  deviations  from  these  measures  of  type. 
Statistical,  verbal,  and  graphical  representation  of  such  deviations 
are  the  devices  to  use  in  making  teachers  conscious  of  the  most 
significant  facts  about  their  pupils.  The  great  advantages  which 
such  representations  have  when  derived  from  standardized  tests 
are  their  precision  and  the  fact  that  they  have  a  common  meaning 
for  all  who  understand  them. 

Almost  from  the  outset,  however,  any  supervisor  who  uses  the 
standardized  test  to  induce  greater  individualization  of  instruction 
will  find  it  necessary  to  supplement  the  mere  statement  of  indivi- 
dual differences  with  precise  information  as  to  their  nature. 
Except  in  the  most  simple  kinds  of  school  work  a  mere  score  is 
not  particularly  illuminating,  even  though  the  unit  of  measure  is 
defined.  A  standardized  test  is  helpful  to  the  teacher  in  just  about 
the  degree  that  it  is  itself  diagnostic  or  makes  diagnosis  possible. 
Furthermore,  it  is  helpful  in  just  about  the  degree  that  the 
teacher  exploits  the  diagnostic  possibilities  herself. 

The  way  to  do  this,  however,  must  be  shown.  As  an  illustra- 
tion of  the  treatment  that  may  be  given  profitably  to  the  papers  of 
a  standardized  test,  devised  to  permit  diagnosis,  the  following 
abridged  supervisor's  report  on  the  accomplishment  of  a  seventh 
grade  is  offered.  The  material  is  Monroe's  Reasoning  Test  in 
Arithmetic  Test  II,  Form  1,  given  January  28,  1919.^ 

The  median  scores  made  in  this  test  by  the  two  seventh  grade  classes 
are  as  follows: 


Class 

Rate  Score 

Principle  Score 

Accuracy  Score 

Mr.  E's  Class 

Mr.  W's  Class.... 

13.7 
11.1 

23.6 
19.8 

15.1 
15.5 

Monroe's    Tentative  Standards 

21 

14 

1  For  detailed  description  of  this  test  see  Walter  S.  Monroe's  Measuring  the  Results 
of  Teaching.  A  copy  of  the  test  can  be  obtained  from  the  Bureau  of  Educational 
Research,  University  of  Illinois,  Urbana,  Illinois. 
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One  class  appears  to  be  about  as  capable  as  the  other  in  this  test,  while 
neither  is  at  present  much  above  the  tentative  standard.  There  is  a  slight 
indication  that  Mr.  E's  pupils  are  less  accurate  than  Mr.  W's.  This  appar- 
ent difference,  however,  may  be  wholly  due  to  the  time  of  day  when  the 
test  was  given  to  the  respective  classes.  Mr.  W's  class  was  tested  in  the 
morning  at  the  second  period,  while  Mr.  E's  was  not  tested  till  afternoon  at 
the  eighth  period.  Pupils  of  this  age  may  be  less  painstaking  and  accurate 
at  the  close  of  a  long  school  day  than  at  the  beginning. 

The  sixth  grade  was  given  the  same  test  a  few  days  earlier  and  scored  as 
follows:  rate  7.7,  principle  15.5,  accuracy  10.  Pupils  in  the  seventh  grade 
making  lower  scores  than  these,  clearly  need  to  be  made  subjects  of  special 
attention  at  once.     A  list  of  such  is  given  herewith:*  .  .  . 

This  test  calls  for  ability  in  the  fundamental  operations  with  integers, 
common  fractions,  and  decimals.  The  actual  mechanical  processes  involved 
are  not  such  as  to  tax  any  seventh  grade  child  provided  with  average  prepara- 
tion. The  types  of  reasoning  called  for  are  also  completely  within  the 
experience  of  boys  and  girls  of  this  grade,  and  no  problem  demands  more 
than  two  steps.  In  the  case  of  only  two  problems  have  our  pupils  any 
excuse  for  failure  on  the  plea  of  lack  of  training;  namely,  the  eleventh  and 
the  thirteenth.  The  eleventh  calls  for  an  understanding  of  the  simplest  sort 
of  commercial  accounting,  and  the  thirteenth  requires  a  knowledge  of  the 
number  of  pounds  in  a  ton.  So  little  attention  has  been  paid  as  yet  to  com- 
mercial forms,  and  so  long  a  time  has  elapsed  since  the  intensive  study  of 
denominate  numbers,  that  many  failures  in  the  problems  named  were  to  be 
expected. 

The  following  list  of  reasons  for  faiUng  in  principle  or  in  accuracy  of 
calculation  covers  the  present  situation  pretty  completely,  as  revealed  by 
the  papers  themselves: 

Errors 

A.  In  Principle: 

1.  Faulty  reasoning 

2.  Careless  reading 

3.  Apparent  ignorance  of  terms  and  concepts  used 

4.  Incorrect  statement  of  division   i%-T-6  instead  of  6-^%), 
though  correct  operation 

5.  Additional  operations  not  called  for 

B.  In  Accuracy: 

6.  Errors  in  fundamental  opei^ations  with  integers 

7.  Errors  in  manipulating  common  fractions 

8.  Errors  in  placing  decimal  point 

9.  Error  in  copying 

10.  Skipped  problem;  probably  unable  to  solve. 

*  In  the  original  report,  names  of  pupils  were  given  at  this  point. 
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Table  I  contains  a  brief  description  of  each  problem,  the 
number  of  pupils  attempting,  the  number  scoring  in  principle, 
the  number  scoring  in  accuracy,  and  a  record  of  the  more 
common  errors  with  the  number  of  pupils  (in  parentheses)  making 
each  error.' 


TABLE  I.      PROBLEM  RECORD 


ATTEMPTS 

NtrUBER  OF  PUPILS  HAVING 

TYPES  OF 

PROBLEM 

Principle 
Correct 

Answer 
Correct 

ERRORS 

1. 

One  step. 
(a+b  =  ?) 
Addition  of  fractions 

41 

39 

37 

1(2),  6(2) 

2. 
One  step. 
(a-b  =  ?) 
Subtraction  of  fractions 

41 

38 

27 

7(7),  9(2),  1(2) 

5. 
Two  steps. 
(a-i-bxc  =  ?) 
Div.  and  mult,  of  dec. 

41 

37 

35 

1(4),  6(2) 

IL 

Two  steps. 

(a+b+  .  .  .  -h  =  ?) 

Addition  and  sub.  of  dec. 

31 

7 

3 

3(20),  10(10) 

In  the  original  report  there  followed  here  a  lengthy  discussion 
of  each  of  the  ten  types  of  error  recognized,  with  a  statement  of 
the  number  of  pupils  making  each  error,  together  with  names  in 
aggravated  cases.  Then  a  final  table  was  offered  giving  the 
individual  records  of  the  pupils  on  each  problem,  on  types  of  error, 
and  in  the  various  test  scores.  This  table  was  presented  in  the 
accompanying  form  (Table  II). 


'  Only  four  of  the  fifteen  problems  are  here  shown.    Forty-one  pupils  took  the 


test. 
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TABLE  n.      INDIVIDUAL  RECOUD 


■r, 

Problems 

3 

1 

2 

3 

4 

5 

6 

A 

Error 

Credit 

Pr. 

1 
0 

Ac. 
0 

Pr. 

1 
0 

Ac. 
0 

Pr. 
1 

Ac. 
1 

Pr. 

7 
0 

Ac. 

1 

Pr. 

1 
0 

Ac. 
0 

Pr. 

1 
0 

Ac. 
0 

B 

Error 

Credit 

1 

1 

1 
0 

0 

1 

1 

0 

1 
0 

1 
0 

0 

1 

6 
0 

To( 
Att. 

15 
15 

Tot 
Pr. 

3 

11 

15 

Tot 
Ac 

Pr. 

1 
0 

1 

Ac. 
0 
1 

1 
9 

The  reader  will  observe  that  the  above  table  is  broken  between 
the  sixth  and  fifteenth  problems.  The  Total  Attempts,  Total 
Credits  in  Principle  and  Total  Credits  in  Accuracy  are  not  therefore 
the  totals  of  the  figures  actually  shown.  The  table  reads :  Pupil  A 
made  errors  of  Type  1  in  principle  (see  code  above)  on  problems 
1,  2,  5,  6,  and  15.  He  obtained  credit  in  principle  on  problems  3 
and  4  with  one  additional  credit  on  a  problem  not  shown,  thus 
making  the  3  credits  indicated  under  "Tot  Pr."  He  also  ob- 
tained a  credit  in  accuracy  on  problem  3,  and  on  no  other,  thus 
making  the  total  credit  of  "1"  indicated  in  the  last  column.  It  is 
to  be  noted  that  if  there  is  an  error  in  principle  on  any  problem  no 
credit  for  accuracy  is  possible. 

A  supervisor  speedily  discovers  that  the  giving  of  tests,  the 
demonstration  of  pupil  variation,  and  the  explicit  diagnosis  of 
individual  weaknesses  will  not  of  themselves  guarantee  any 
marked  change  in  teaching  method.  Group  methods  constitute 
too  much  of  an  obsession  to  be  easily  thrown  off  even  in  part. 
It  must  be  made  insistently  clear  that  the  results  desired  from 
teaching  are  individual  results  and  not  class  results. 

The  standardized  test  performs  a  distinct  service  in  pointing 
out  where  to  look  for  specific  troubles  when  minimum  require- 
ments are  furnished  in  terms  of  the  units  of  the  test.     For 
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example,  standards  in  handwriting  may  be  stated  in  some  such 
form  as  the  one  shown  in  Table  III. 

TABLE  III.     STANDARDS  IN  HANDWRITING 


Grade 

Ayres'  Quality 

Letters  per  Min. 

Percent  of  Class 

III 

40 

45 

80 

IV 

40 

50 

80 

V 

50 

55 

80 

VI 

50 

60 

80 

VII 

60 

65 

80 

VIII 

60 

70 

80 

A  similar  statement  of  standards  is  possible  today  in  practically 
all  elementary-school  fundamentals  and  in  certain  high-school 
subjects  as  well.  Increased  individualization  is  sure  to  follow 
such  prescriptions,  for  in  no  other  way  can  the  required  results 
be  achieved  with  reasonable  economy. 

The  extensive  use  of  the  standardized  test  for  the  purposes 
outlined  above,  if  for  no  other,  is  strongly  recommended  to  super- 
visors. It  will  do  a  great  deal  at  once  to  center  attention  on  the 
pupil  instead  of  on  the  class.  It  will  not  solve  the  ultimate  prob- 
lem of  teaching  technic,  but  it  will  produce  the  necessary  ante- 
cedent conditions  of  enlightenment  and  stimulation.  Therefore, 
when  this  report  was  submitted,  the  teachers  were  asked  to  make 
it  the  basis  not  only  of  a  more  analytical  procedure  in  terms  of  the 
subject,  but,  especially,  of  a  more  individualized  procedure  in 
terms  of  the  pupil.  Attention  to  the  specific  troubles  of  each  of 
these  pupils  as  revealed  in  the  Individual  Record  (Table  II)  was 
held  to  be  far  more  profitable  than  marshaling  them  as  a  group 
through  daily  recitation  maneuvers. 


CORRELATION  OF  PHYSICAL  HEALTH  AND 
MENTAL  EFFICIENCY 

R.  L.  Sandwick 
Principal,  Deerfield-Shields  Township  High  School,  Highland  Park,  lUinois 

The  following  study,  made  in  one  school,  of  the  relation  between 
mental  power  as  determined  by  an  intelligence  test  and  compara- 
tive freedom  from  physical  defects,  is  submitted  to  the  Journal 
OF  Educational  Research  in  the  hope  that  similar  studies  may 
be  made  in  other  schools.  It  is  important  to  know  whether  the 
remarkable  parallelism  between  mental  inefficiency  and  physical 
defects  here  shown  is  merely  accidental,  or  indicative  of  a  general 
condition. 

The  Group  Intelligence  Test  by  Rugg  and  Freeman^  was 
given  to  423  of  the  students  enrolled  in  the  Deerfield-Shields 
High  School  on  September  18,  1919.  The  statistical  work  in 
connection  with  the  test  was  handled  by  Mr.  Harry  G.  Pertz, 
who  presented,  among  other  matters,  a  chart  showing  the  scores 
of  the  forty  ablest  students  as  determined  by  the  test,  and  of  the 
forty  students  making  the  lowest  scores.  He  also  arranged  the 
whole  423  students  in  order  of  scoring  ability  from  the  highest 
with  a  score  of  81.5  to  the  lowest  with  a  score  of  8. 

Mr.  Pertz  had  made  a  similar  gradation  of  these  students  a  year 
ago  after  all  of  them  had  taken  the  Kansas  Silent  Reading  Test. 
In  general  the  two  tests  show  parallel  ability.  Most  students 
who  ranked  high  in  the  Kansas  Silent  Reading  Test  also  ranked 
high  in  the  Group  Intelligence  Test.  There  were  a  few  con- 
spicuous examples  of  the  failure  of  this  general  rule.  One  student 
who  ranked  seventy-ninth  in  the  test  last  year  ranked  second  this 
year.  It  was  known  that  this  particular  boy  had  had  some  rather 
serious  physical  defects  remedied  by  surgical  operation — defects 
which  had  interfered  with  his  health  the  previous  year.  He  had 
spent  the  summer  on  a  farm  in  the  open  air,  and  had  gained  about 
thirty  pounds  in  weight  in  a  year's  time.     Being  impressed  by 

^The  Freeman-Rugg  Group  Intelligence  Tests  were  designed  to  measure  the 
general  intelligence  of  junior  and  senior  high-school  pupils.  Address,  University  of 
Chicago  Bookstore,  Chicago,  Illinois.  Price  5  cents  a  sample  set;  3  cents  each  m 
quantities  ' 
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TABLE  I.      STUDENTS  HAVING  FORTY  HIGHEST  SCORES 


Student 

Intelligence 

_._ 

No. 

Score 

Physical  Defects 

1 

81.5 

No  defects 

2 

78.0 

No  defects 

3 

75.0 

No  defects 

4 

75.0 

Teeth 

5 

73.5 

No  defects 

6 

72.5 

No  defects 

7 

71.5 

No  defects 

8 

71.0 

No  defects 

9 

71.0 

No  defects 

10 

70.0 

No  defects 

11 

70.0 

No  defects 

12 

70.0 

Teeth,  vision  (not  bad) 

13 

70.0 

Skin  disease  (slight) 

14 

69.0 

Teeth 

15 

67.0 

No  defects 

16 

66.5 

No  defects 

17 

66.5 

No  defects 

18 

66.0 

Vision  (slight),  teeth  (not  bad),  glands  (temporary 
from  cold) 

19 

66.0 

Christian  Scientist  (excused  from  physical  examina- 
tion) 

20 

65.5 

Pulmonary  disease,  nasal  breathing 

21 

65.5 

Slight  acne,  hearing  (from  cold) 

22 

64.5 

Teeth  (small  filling  dropped  out) 

23 

64.0 

No  defects 

24 

64.0 

No  defects 

25 

64.0 

No  defects 

26 

64.0 

No  defects 

27 

64.0 

Cardiac  (result  of  influenza) 

28 

63.5 

Vision  (wears  glasses) 

29 

63.0 

No  defects 

30 

63.0 

T^insils  (temporarily  enlarged) 

31 

62.5 

Vision  (eyes  slightly  crossed) 

32 

62.5 

Cardiac 

33 

62.5 

Tonsils 

34 

62.0 

Teeth  (not  serious) 

35 

62.0 

Tonsils  (from  cold),  vision  (slight  astigmatism),  glands 

36 

62.0 

No  defects 

37 

61.0 

Christian  Scientist  (excused  from  physical  examina- 
tion) 

38 

61.0 

Tonsils  (slightly  enlarged),  teeth 

39 

60.5 

No  defects 

40 

60  0 

No  defects 
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TABLE  II.      STUDENTS  HAVING  FORTY  LOWEST  SCORES 


Student 

Intelligence 

No. 

Score 

Physical  Defects 

1 

29.5 

Skin,  cardiac,  pulmonary 

2 

29.5 

Neivous  disease,  cardiac,  pulmonary,  tonsils,  adenoids 

3 

29.0 

Enlarged  glands,  goitre,  cardiac  disease,  skin,  vision, 
teeth,  tonsils 

4 

29.0 

Enlarged    glands,    cardiac,    pulmonary,    orthopaedic 

5 

29.0 

Enlarged  glands,  goitre,  pulmonary,  other  defects  of 
eye,  tonsils,  teeth 

6 

29.0 

Enlarged  glands,  vision,  nasal  breathing,  tonsils 

7 

29.0 

Cardiac,  pulmonary,  orthopaedic,  vision,  tonsils 

8 

28.5 

Glands,  vision,  nasal  breathing,  tonsils 

9 

28.5 

Pulmonary,  vision,  teeth,  tonb«ils 

10 

27.5 

Enlarged  glands,  cardiac,  pulmonary,  vision 

11 

27.5 

Enlarged  glands,  cardiac,  pulmonary,  vision,  teeth, 

tonsils 

12 

27.0 

Enlarged  glands,  goitre,  tonsils 

13 

27.0 

Tonsils,  vision 

14 

27.0 

Pulmonary,  teeth 

15 

27.0 

Tonsils,  teeth 

16 

27.0 

Teeth,  tonsils,  adenoids 

17 

26.5 

Teeth,  tonsils,  adenoids 

18 

25.0 

Glands,  skin  disease 

19 

25.0 

Glands,  goitre,  cardiac 

20 

24.5 

Enlarged  glands 

21 

24.5 

Tonsils,  vision,  cardiac 

22 

24.5 

Vision,  goitre 

23 

21.0 

Cardiac,  teeth,  vision,  tonsils 

24 

21.0 

Vision,  goitre 

25 

20.5 

Cardiac,  skin,  rachitic  type,  teeth,  tonsils 

26 

20.5 

Pulmonary,  tonsils 

27 

20.0 

Cardiac,  teeth,  tonsils 

28 

20.0 

Teeth,  adenoids 

29 

19.0 

Vision 

30 

19.0 

Enlarged  glands 

31 

18.0 

Teeth,  nasal  breathing 

32 

17.0 

Enlarged  glands,  goitre,  cardiac,  teeth,  tonsils 

33 

15.5 

(Not  examined) 

34 

15.0 

Nasal  breathing,  teeth,  glands,  tonsils 

35 

14.0 

Teeth,  goitre,  glands 

36 

13.0 

Cardiac,  tonsils 

37 

13.0 

Tonsils,  glands 

38 

12.0 

Disease  of  eye,  teeth,  tonsils,  discharging  ear 

39 

10.0 

Cardiac,  pulmonary,  vision,  teeth,  hearing 

40 

8.0 

Tonsils 
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In  Group  with 
Lowest  Scores 


Total  number  of  defects 

Average  number  of  defects  per  student . . . 
Percent  having  no  defects 


125 
3.41 
0 


this  boy's  showing  in  the  test,  and  thinking  that  physical  condi- 
tion might  bear  some  relation  to  defects,  we  put  the  list  of  forty 
students  with  best  scores  and  the  list  of  forty  students  with  poorest 
scores  into  the  hands  of  our  school  nurse  with  instructions  to  give 
us  the  health  card  of  every  student.     The  records  are  given  above. 

It  was  noticeable  that  the  defects  among  the  ablest  group 
were  not  only  fewer  in  number  but  also  less  serious  in  character. 
Some  of  them,  indeed,  were  only  temporary.  Most  of  the  defects 
among  both  groups  are  entirely  remediable. 

In  Figure  1  details  are  shown  as  to  the  existence  of  each  de- 
fect in  the  groups  having  highest  and  lowest  scores.  Of  the  fifteen 
defects  only  one  occurred  oftener  among  the  students  having 
the  highest  scores.  This  was  due  to  a  single  case  of  defective 
hearing  which  was  found  in  a  girl  belonging  to  the  high  group. 
Of  course,  this  case  has  no  significance  whatever  beside  such 
facts  as  these:  that  60  percent  of  the  low  group  had  defective 
tonsils  compared  with  10  percent  for  the  high  group;  that  45 
percent  of  the  low  group  had  defective  teeth  compared  with  17 
percent  for  the  high  group;  etc. 

Although  the  number  of  cases  is  small,  the  investigation  adds 
something  to  the  accumulating  evidence  that  Ihe  child  of  good 
intellectual  abihty  is  also  of  good  physical  ability.  In  other 
words,  it  supports  the  view  that  the  gifted  child  is  not  likely  to 
be  the  physical  and  nervous  wreck  that  some  have  supposed. 
It  also  contributes  to  the  growing  conviction  that  good  abilities 
may  be  and  often  are  masked  through  the  presence  of  physical 
defects.  And  it  points  to  the  unmistakable  duty  of  the  school 
to  provide  for  every  child  early  and  frequent  medical  inspection 
with  a  systematic  follow-up  in  applying  remedies. 
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FIGURE    1.      PROPORTION  OF  DEFECTS  AMONG  THE  FORTY  PUPILS 
HAVING  THE  HIGHEST  AND  LOWEST  INTELLIGENCE  SCORES 
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A  STATE-WIEE  SCHOOL-BUILDING  SURVEY 

George  Drayton  Strayer 

Teachers^  College,  Columbia  University 

State  control  of  school  buildings  has  been  exercised  in  the 
United  States  in  some  degree  by  having  the  plans  for  new  buildings 
passed  upon  by  the  state  architect  or  by  some  special  officer  in 
the  state  department  of  education.  Laws  have  also  been  enacted 
which  require  inspection  and  approval  by  the  state  department 
of  education  v/hen  repairs  exceeding  a  minimum  amount  are 
undertaken.  This  control  has  helped  over  a  period  of  years  to 
develop  a  somewhat  better  type  of  building  as  the  population  has 
increased  and  as  new  buildings  have  been  needed.  There  has 
been  little  or  no  control,  however,  over  buildings  which  were 
already  in  use  and  which  were  not  reconstructed  so  as  to  come 
under  the  provisions  of  the  law. 

Throughout  the  United  States  there  are  today  thousands  of 
school  buildings  which  are  unfit  for  use,  and  in  many  cases  dan- 
gerous in  the  extreme  because  of  the  unhygienic  conditions  or 
fire  risks  involved.  There  is  need  throughout  the  country  for 
state-wide  school-building  surveys  which  will  reveal  the  condi- 
tions and  which  will  arouse  the  public  to  the  need  of  well- 
considered  school-building  programs. 

The  state  of  Delaware  is  the  first  to  undertake  this  particular 
type  of  survey.  Through  the  generosity  of  Mr.  Pierre  S.  du  Pont, 
the  state  has  been  provided  with  a  fund  for  the  construction  of 
its  school  buildings.  In  every  case  the  local  community  is  to 
provide  funds  equal  to  or  more  than  those  provided  by  the 
du  Pont  fund,  except  in  the  case  of  schools  for  colored  children,  where 
the  whole  cost  will  be  borne  by  those  administering  Mr.  du  Pont's 
gift.  In  order  to  know  definitely  the  condition  of  school  buildings 
throughout  the  state,  Mr.  du  Pont  employed  the  writer  and  his 
colleagues  to  make  a  school-building  survey  of  all  of  the  school- 
houses  in  the  state  outside  of  the  city  of  Wilmington.^    Every 

1  Strayer,  George  D.,  Engelhardt,  N.  L.,  and  Hart,  F.  W.  General  report  on 
school  buildings  and  grounds  of  Delaware.  (Bulletin  of  the  Service  Citizens  of  Dela- 
ware, V.  1,  no.  3).     Wilmington,  Delaware:  Service  Citizens  of  Delaware,  1919. 
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one  of  these  school  buildings  was  visited  by  one  or  more  of  the 
survey  commission  and  rated  with  respect  to  site,  building, 
service  systems,  classrooms,  and  special  rooms.  Each  of  these 
main  divisions  of  the  score  is  made  up  of  certain  subdivisions 
appearing  upon  a  score  card  which  permits  of  a  maximum  of  one 
thousand  points  for  a  perfect  building.^ 

Included  under  site  are  location,  drainage,  size  and  form,  and 
flagpole.  Under  building  are  included  placement,  gross  structure, 
and  internal  structure.  Under  service  systems  are  included  heating 
and  ventilation,  fire  protection,  cleaning  system,  artificial  lighting, 
schedule  and  emergency  equipment,  water  supply  system,  and 
toilet  systems.  Under  classrooms  are  included  arrangement, 
construction  and  finish,  illumination,  cloakrooms  and  wardrobes, 
and  equipment.  Under  special  rooms  are  included  rooms  for 
general  use,  such  as  playroom,  community  room,  library,  and 
"unch  room;  officials'  consultat'on  room,  and  other  special  service 
rooms  (e.g.,  those  for  industrial  arts  and  household  arts),  fuel 
'■oom,  storage  room,  and  the  like.  Each  o  these  subdivisions  is 
again  analyzed  so  as  to  indicate  the  detail  which  one  needs  in 
scoring  a  school  building.  Accompanying  the  score  card  is  a 
set  of  standards  which  has  been  worked  out  with  the  cooperation 
of  a  large  number  of  persons  interested  in  educational  adminis- 
tration, in  school  architecture,  and  in  schoolhouse  construction. 

The  astonishing  thing  revealed  by  the  survey  in  Delaware  is 
the  almost  complete  lack  of  suitable  buildings  and  equipment 
throughout  the  state.  This  is  particularly  true  with  respect  to 
the  village  and  rural  schools — i.e.,  the  schools  having  one  to  four 
teachers.  If  one  accepts  four  hundred  points  out  of  a  thousand 
as  the  minimum  score  for  a  building  that  is  to  be  permitted  to 
continue  in  use,  there  are,  of  the  school  buildings  of  more  than 
four  teachers,  just  seven  buildings  in  the  state,  outside  of  Wil- 
mington, which  should  be  left  standing.  The  following  table 
gives  the  scores  for  these  buildings. 

An  analysis  of  the  partial  scores  allowed  estabHshes  the  fact 
that  these  low  scores  do  not  depend  upon  a  failure  to  provide  any 

*  Strayer  and  Engelhardt  Score  Card  for  City  School  Buildings  and  Score  Card  for 
One  to  Four-Teacher  School  Buildings.  Published  by  the  Bureau  of  Publications, 
Teachers'  College,  Columbia  University,  New  York  City. 
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one  element  that  goes  to  make  up  a  satisfactory  building,  but, 
rather,  that  the  buildings  are  unfit  for  use,  regardless  of  the  par- 
ticular standard  applied. 

TABLE   I.      SCORES    FOR   CITY    SCHOOL   BUILDINGS    OF   MORE    THAN 

FOUR  TEACHERS 

(Arranged  in  Order  of  Rank) 


Scores  of 

Location 

Buildings 

850-899 

Alex  I.  du  Pont 

800-849 

Caesar  Rodney 

750-799 

(None) 

700-749 

» 

650-699 

» 

600-M9 

Harrington 

550-599 

Bridgeville 

500-549 

Greenwood 

450^99 

Frederica,  Mt.  Pleasant 

400-449 

(None) 

350-399 

Rehoboth,  Newark  Grammar..  Dover 

300-349 

Shelbyville,  MUford,  Lewes,  Milton, 

Georgetown,  Smyrna,  Middletown, 

New  Castle  Elementary,  Seaford, 

Delaware  City 

250-299 

Felton,  Laurel,  Delmar 

200-249 

Newark  Academy,  Millsboro, 

Frankford 

150-199 

Clayton,    New    Castle    Academy, 

Dagsboro 

The  rural  schools,  however,  show  even  more  deplorable  con- 
ditions; and  since  school  surveys  have  generally  treated  of  city 
school  buildings,  it  seems  best  to  analyze  the  situation  in  detail 
for  these  rural  communities.  Only  schools  for  white  children  will 
be  considered.  In  Table  II  are  given  the  scores  assigned  to  each 
of  the  two  hundred  and  ninety-three  village  and  rural  schools  for 
such  children — to  the  schools,  in  other  words,  having  one  to  four 
teachers. 
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TABLE  n. 


SCORES  FOR  ONE-  TO  FOUR-TEACHER  SCHOOLS 
FOR  WHITE  CHILDREN 

(Maximum  Possible  Score,  1,000) 


Scores  of 

No.  of 

Buildings 

Buildings 

0-  49 

0 

50-  99 

1 

100-149 

6 

150-199 

21 

200-249 

72 

250-299 

90 

300-349 

49 

350-399 

31 

400-449 

15 

450-499 

5 

500-549 

2 

550-599 

0 

600-649 

0 

650-699 

1 

Total 

293 

25-percentile 

230.77 

Median 

275.00 

75-percentile 

329.35 

This  table  reads  as  follows:  one  building  scored  between  50 
and  99  points,  and  six  buildings  scored  between  100  and  149 
points.  As  is  indicated  at  the  bottom  of  the  column  headed 
"Number  of  Buildings,"  one  quarter  of  the  whole  number  of 
buildings  scored  less  than  231  points,  one-half  of  them  less  than 
275  points,  and  three-quarters  of  them  less  than  330  points. 

An  analysis  of  the  scores  given  to  these  schools  with  respect  to 
site,  building,  service  systems,  classrooms,  and  special  rooms  will 
make  clear  the  need  for  the  reconstruction  of  nearly  all  of  these 
buildings  on  a  new  site. 

With  reference  to  site,  it  will  be  observed  that,  according  to 
Table  III,  one-half  of  the  buildings  scored  less  than  66  points  out 
of  a  possible  160.  Stated  in  terms  of  the  actual  situation,  it  may 
be  said  that  the  typical  school  site  in  Delaware  is  a  piece  of 
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ground,  triangular  or  rectangular  in  form,  with  an  area  of  less 
than  one-half  an  acre,  in  the  angle  of  a  crossroads.  It  is  ordinarily 
not  considered  suitable  for  cultivation;  and  it  is  not  infrequently 
so  low  as  to  make  it  difficult  or  impossible  to  drain  it  properly. 
In  a  great  many  cases  this  Kttle  plot  of  ground  is  either  in  a  densely 
wooded  section  or  on  the  edge  of  a  forest  or  swamp.  Village  and 
rural  schools  in  Delaware  need  larger  and  better  school  sites. 
Playgrounds,  play  apparatus,  and  teachers  who  can  teach  children 
how  to  play,  are  needed  throughout  the  state.  The  survey 
has  revealed  the  need,  and  the  people  will,  it  is  hoped,  provide 
the  sites. 


TABLE  ni.      SCORES  FOR  ONE-  TO  FOXJR-TEACHER 

SCHOOLS  FOR  WHITE  CHILDREN  WITH 

EESPECT  TO  SCHOOL  SITE 


(Maximum  Possible  Score,  160) 

Scores 

No.  of 

Buildings 

0-    9 

0 

10-  19 

2 

20-  29 

7 

30-  39 

20 

40-49 

19 

50-  59 

38 

60-  69 

63 

70-  79 

37 

80-  89 

40 

90-  99 

31 

100-109 

16 

110-119 

14 

120-129 

3 

130-139 

3 

Total 

293 

25-percentile 

55.32 

Median 

66.00 

75-percentiJe 

86.75 
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A  maximum  possible  score  of  200  points  is  allowed  for  the 
building,  as  such,  including  its  placement  on  the  site,  its  gross 
structure,  and  its  internal  structure.  Gross  structure  includes 
the  type  of  building,  material  used,  height,  roof,  foundation, 
walls,  entrances,  and  the  like.  Internal  structure  includes  stair- 
ways, vestibules,  corridors,  basement,  color  scheme,  and  the 
like.     The  scores  for  these  elements  are  indicated  in  Table  IV. 

TABLE  IV.      SCORES  FOR  ONE-  TO  FOUR-TEACHER  SCHOOLS 

FOR  WHITE  CHILDREN  WITH  RESPECT  TO 

GROSS  STRUCTURE  OF  BUILDING 

(Maximum  Possible  Score,  200) 


Scores 

No.  of 

Buildings 

0-    9 

0 

10-  19 

3 

20-  29 

4 

30-  39 

21 

40-  49 

38 

50-  59 

59 

60-  69 

60 

70-  79 

48 

80-  89 

19 

90-  99 

14 

100-109 

12 

110-119 

6 

120-129 

5 

130-139 

2 

140-149 

1 

150-159 

0 

160-169 

1 

Total 

293 

25-percentiJe 

50.23 

Median 

62.66 

75-percentile 

76.09 

It  will  be  observed  by  reading  this  table  that  one-half  of  the 
buildings  scored  less  than  63  points  out  of  a  total  of  200.     Most 
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of  the  buildings  in  Delaware  are  very  old  frame,  stone,  or  brick 
structures,  that  have  outlived  their  usefulness.  The  typical 
building  is  a  most  unattractive,  store-box  type  of  structure,  with 
windows  located  at  regular  intervals  on  two  or  three  sides,  with 
the  entrance  on  the  fourth  side.  In  almost  no  case  is  there  any 
evidence  of  an  attempt  to  make  the  school  building  attractive 
architecturally.  In  many  of  these  buildings  there  is  not  even  a 
vestibule.  In  more  than  half  of  them  no  cloakroom  is  provided. 
In  many  instances  the  roof,  sadly  in  need  of  repair,  has  permitted 
enough  water  to  enter  the  building  to  damage  the  plaster,  even 
to  the  point  of  causing  a  large  part  of  it  to  fall  off  the  ceiling  and 
walls.  In  some  cases  a  leaking  roof  has  resulted  in  a  moldy 
interior,  totally  unfit  for  school  purposes.  Floors  are  badly 
damaged,  books  are  moldy,  and  school  furniture  is  discolored  and 
covered  with  dirt  on  account  of  a  failure  to  provide  adequate 
protection  against  the  rain. 

The  most  striking  failure  to  provide  adequately  for  these 
school  children  is  revealed  in  the  scores  which  were  allowed  for 
service  systems.  When  one  remembers  that  this  includes  heating 
and  ventilation,  fire  protection,  cleaning,  artificial  lighting,  water 
supply  system,  and  toilets,  it  is  easy  to  understand  what  a  very 
low  score  means. 

From  Table  V  it  will  be  observed  that  one-half  of  the  school 
buildings  rece'ved  a  score  of  less  than  55  points  out  of  a  possible 
250.  More  than  half  of  these  buildings  had  no  source  of  heat 
other  than  the  old-fashioned  stove  placed  in  the  middle  of  the 
room.  Only  three  buildings  were  provided  with  inside  toilets. 
The  toilets  placed  on  the  school  grounds  were  almost  uniforml}- 
in  a  most  unsanitary  condition,  and  were  very  generally  marked 
with  obscene  pictures  and  writing.  If  the  children  of  the  state 
are  to  be  properly  cared  for  and  freed  from  the  contaminating 
influence  of  the  outhouses  now  found  everywhere  on  the  grounds, 
toilet  rooms  on  the  same  floor  as  the  classrooms,  with  sewer 
connections,  sewage  disposal,  or  mechanical  toilet  tank,  should 
be  installed.  In  the  buildings  which  are  to  be  constructed  a 
modern  form  of  jacketed  stove  should  be  provided;  or,  if  the 
consolidations  proposed  by  the  survey  commission  are  made, 
heating  plants  in  the  basement  should  be  installed. 
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TABLE  V.      SCORES  FOR  ONE-  TO  FOUR-TEACHER 

SCHOOLS  FOR  WHITE  CHILDREN  WITH  RESPECT 

TO  SERVICE  SYSTEMS 

(Maximum  Possible  Score,  250) 


Scores 

No.  of 

Buildings 

0-    9 

0 

10-  19 

2 

20-  29 

17 

30-  39 

48 

40-  49 

52 

50-  59 

50 

60-  69 

71 

70-  79 

31 

80-  89 

13 

90-  99 

5 

100-109 

3 

110-119 

0 

120-129 

0 

130-139 

0 

140-149 

0 

150-159 

0 

160-169 

0 

170-179 

0 

180-189 

0 

190-199 

1 

Total 

293 

25-percentile 

40.18 

Median 

54.50 

75-percentile 

66.24 

Space  devoted  to  classroom  use  is  allowed  a  score  of  225 
points  out  of  a  thousand.  Under  this  head  are  included  the  size 
and  form  of  the  classroom,  its  floors,  walls,  ceiling,  and  their 
condition,  the  lighting  of  the  room,  the  furniture,  the  cloakroom 
and  wardrobes  adjacent  to  or  included  in  the  classroom,  black- 
boards, pictures,  and  teaching  equipment. 
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TABLE  VI.      SCORES  FOR  ONE-  TO  FOUR-TEACHER 

SCHOOLS  FOR  WHITE  CHILDREN  WITH  RESPECT 

TO  CLASSROOMS 

(Maximum  Possible  Score,  225) 


Scores 

No.  of 
Buildings 

0-    9 

0             ;,-< 

10-  19 

0 

20-  29 

0 

30-  39 

1 

40-  49 

3 

50-  59 

13 

60-  69 

31 

70-  79 

40 

80-  89 

47 

90-  99 

69 

100-109 

30 

110-119 

15 

120-129 

17 

130-139 

11 

140-149 

5 

150-159 

5 

160-169 

1 

170-179 

2 

180-189 

1 

Total 

293 

25-percentile 

74.75 

Median 

90.34 
103.82 

75-percentile 

It  will  be  observed  from  reading  Table  VI  that  one-half  of 
the  schools  were  scored  less  than  90  points  out  of  a  possible  225. 
This  is  due  to  the  fact  that  in  most  cases  the  classroom  was  not 
sufl&cient  in  size,  that  in  many  cases  the  floor,  walls,  and  ceiling 
were  in  miserable  condition,  that  the  lighting  of  the  room  was 
very  seldom  satisfactory,  that  the  furniture  was  often  of  a  very 
old  type  and  seldom  of  a  suf&cient  number  of  sizes  to  accom- 
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modate  the  children  of  the  different  age  groups,  and  that  in 
general  there  was  a  most  remarkable  absence  of  pictures,  charts, 
globes,  or  other  teaching  equipment. 

In  order  to  conduct  a  modern  school,  rooms  other  than  class- 
rooms must  be  provided.  One  hundred  and  sixty-five  points 
are  allowed  on  the  score  card  for  special  rooms,  under  which 
head  are  classified  playroom,  community  room,  officials'  consulta- 
tion room,  library,  lunch  room,  space  for  industrial  and  household 
arts,  and  fuel  room.  It  is  the  contention  of  the  survey  commis- 
sion that  no  one-room  school  provides  the  space  necessary  for 
the  education  of  children  of  the  varying  ages  found  in  a  rural 
school.     The  scores  for  special  rooms  appear  in  Table  VII. 


TABLE  VII,      SCORES  FOR  ONE-  TO  FOUR-TEACHER 

SCHOOLS  FOR  WHITE  CHILDREN  WITH  RESPECT 

TO  SPECIAL  ROOMS 

(Maximum  Possible  Score,  165) 


Scores 

No.  of 

Buildings 

0 

33 

1 

27 

2 

103 

3 

92 

4 

13 

5 

11 

6 

1 

7 

2 

8 

0 

9 

1 

10-19 

2 

20-29 

4 

30-39 

1 

40-49 

3 

Total 

293 

2S-percentile 

1.12 

Median 

1.84 
2.60 

75-percentile 
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The  reading  of  the  table  ind'cates  that  a  very  minimum  of 
such  equipment  has  been  provided  for  the  one-  to  four-teacher 
schools  of  Delaware.  Only  14  buildings  out  of  the  293  rural 
schools  for  white  children  received  more  than  5  points  out  of  a 
possible  165. 

Certain  other  interesting  facts  with  respect  to  these  buildings 
are  indicated  in  Table  VIII.  From  this  table  it  will  be  observed 
that  45  percent  of  the  buildings  are  located  oa  a  triangular  or 
irregular  site,  that  30  percent  of  them  are  without  vestibules, 
and  so  on  for  the  other  items. 


TABLE  VIII.      NUMBER  AND  PERCENT  OF  BUILDINGS 
WITH  SPECIFIED  DEFECTS  AND  FACILITIES 


Located  on  triangular  or  irregiUar  site. 

Without  vestibule 

No  water  supply 

Without  unproved  type  of  heater 

Without  flagpole 

Without  cloakrooms 

Low  in  glass  area 

Light  from  1  side 

"     2  sides 

"     3  sides 

"     4  sides 

"     5  sides 

"     6  sides 

"     7  sides 

With  gas  or  electricity 

With  indoor  toilets 

With  playroom 

With  community  room 

With  office 

With  industrial  arts 

With  household  arts 

With  library 

With  lunch  room 


No.  of 

Buildings 

Percent 

131 

45.0 

87 

30.0 

81 

28.0 

134 

45.7 

120 

41.0 

183 

62.5 

144 

49.1 

0 

0 

165 

56.3 

102 

35.0 

15 

5.1 

0 

0 

1 

0.3 

1 

0.3 

4 

1.4 

3 

1.0 

4 

1.4 

5 

1.7 

1 

0.3 

0 

0 

0 

0 

1 

0.3 

1 

0.3 

A  similar  set  of  tables  of  scores  for  the  buildings  used  by  the 
colored  children  of  the  state  would  indicate  an  even  more  deplora- 
ble situation  than  that  revealed  in  the  analysis  of  the  provisions 
made  for  the  white  children. 
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The  hopeful  part  of  the  entire  situation  for  Dela^  ar2,  how- 
ever, is  to  be  found  in  the  generosity  of  Mr.  du  Pont  and  in  the 
action  already  taken  by  a  great  many  communities  to  abandon 
the  buildings  which  are  unfit  for  use  and  to  construct  modern 
schools  buildings  on  adequate  sites.  These  new  buildings  will 
cost  more  than  has  heretofore  been  expended  on  school  buildings 
in  the  state  of  Delaware.  If  the  recommendations  of  the  survey 
commission  are  followed,  the  number  of  one-teacher  schools  will 
be  diminished  very  rapidly  on  account  of  the  consolidations  which 
will  be  effected.  There  may  remain  a  very  few  one-teacher 
schools,  but  even  in  these  remote  communities  adequate  facilities 
should  be  provided,  even  though  the  cost  be  greater;  and  un- 
usually capable  teachers  should  be  provided  for  them,  even  though 
it  may  be  necessary  to  pay  a  larger  salary  than  is  ordinarily  paid 
to  those  who  teach  in  the  towns  and  cities  of  the  state, 

A  similar  survey  of  the  school  buildings  of  other  states  might 
show  either  a  better  or  a  worse  condition.  It  can  be  confidently 
stated,  however,  that  any  such  survey  would  make  clear  the 
necessity  for  the  development  of  a  state-wide  school-building 
program  such  as  has  been  undertaken  in  no  state  except  Delaware. 


SHORTER  METHOD  FOR  COMPUTING 
THE  COEFFICIENT  OF  CORRELATION 

Leonard  P.  Ayres 
Russell  Sage  Foundation,  New  York  City 

The  coefficient  of  correlation  measures  the  agreement  between 
two  series  of  numbers.  The  numbers  are  in  pairs  and  each  num- 
ber in  the  first  series  is  the  first  member  of  a  pair  of  measurements, 
while  the  corresponding  number  in  the  second  series  is  the  second 
member  of  that  pair.  The  object  of  computing  the  coefficient 
of  correlation  is  to  find  in  what  degree  smaller  quantities  in  one 
series  imply  correspondingly  smaller  quantities  in  the  other,  and 
larger  quantities  in  the  one  imply  correspondingly  larger  quanti- 
ties in  the  other.  The  coefficient  of  correlation  does  this  by 
comparing  the  amount  of  agreement  that  does  exist  with  the 
perfect  agreement  that  might  exist. 

The  Pearson  Coefficient 
The  formula  for  finding  the  Pearson  coefficient  of  correlation 
is  best  expressed  as: 

S     (x.y) 

r= — zi=: =rz 

In  this  formula: 

r  —  correlation 

S  =  summation 

X  =  deviations  from  the  average  of  the  first  series 

y  =  deviations  from  the  average  of  the  second  series 

The  use  of  the  formula  may  be  illustrated  by  finding  the 
correlation  between  two  short  and  simple  series  as  follows: 

3  6 

4  5 

5  7 
8  11 

10  11 

30  40  "^ 

Since  there  are  five  numbers  in  each  series,  the  average  of  the  first 
series  is  6,  and  that  of  the  second  is  8.     The  next  step,  according 
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to  the  formula,  is  the  finding  of  the  deviations  of  these  numbers 
away  from  their  averages.  Calling  these  deviations  x  and  y 
they  are  as  follows: 


X 

y 

-3 

-2 

-2 

-3 

-1 

-1 

+2 

+3 

+4 

+3 

It  is  clear  that  there  is  considerable  agreement  between  the  general 
trends  of  these  two  series.  Large  minus  deviations  in  the  first 
series  are  accompanied  by  large  minus  deviations  in  the  second 
series  and  large  plus  deviations  in  the  first  by  large  plus  deviations 
in  the  second.  The  problem  is  to  find  how  nearly  complete  this 
agreement  is;  how  near  the  partial  agreement  that  does  exist 
comes  to  equaling  the  perfect  agreement  that  might  exist. 

The  Actual  Deviations 
This  involves  comparing  the  actual  deviations  of  these  two 
series  with  those  that  might  be  found  if  the  agreement  were  per- 
fect. The  actual  deviations  are  measured  by  multiplying  the 
rorrespoading  members  of  the  two  series  and  getting  the  sum  of 
these  products  as  follows: 

xy 
+6 
+6 
+1 
+6 
+12 

31 

Deviations  for  Perfect  Agreement 
The  next  step  is  to  find  a  measure  of  the  deviations  that  would 
exist  if  the  agreement  between  the  two  series  were  perfect.  The 
first  deviation  of  the  x  series  is  —3  and  the  second  is  —2.  If  the 
corresponding  deviations  of  the  second  series  were  identical 
they  would  also  be  —3  and  —2  and  there  would  be  perfect 
agreement. 

*  Following  the  method  already  used  in  measuring  the  actual 
deviations,  a  measurement  may  be  found  for  the  deviations  that 
would  exist  if  all  those  of  the  second  series  were  equal  to  those 
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in  the  first.  This  is  done  by  multiplying  all  these  deviations  of 
the  first  series  by  themselves  or  finding  their  squares.  The  same 
process  is  now  carried  through  with  the  second  series  and  the 
squares  of  both  series  of  deviations  are  the  following: 

«?  y» 

9  4 

4  9 

1  1 

4  9 

16  9 

34  32 

We  now  have  three  quantities:  31  which  measures  the  actual 
deviations  of  the  two  series,  34  which  shows  what  the  deviations 
of  the  X  series  would  amount  to  if  they  were  accompanied  by 
identical  deviations  in  the  y  series,  and  32  which  shows  what 
those  of  the  y  series  would  amount  to  if  they  were  accompanied 
by  identical  deviations  in  the  x  series. 

Comparing  the  Actual  with  the  Possible 
The  actual  deviations  must  now  be  compared  with  those  that 
might  exist  if  the  correlation  were  perfect.  This  is  done  by 
comparing  31  with  34  and  32  simultaneously  and,  since  34  and  32 
are  the  sums  of  series  of  squares,  the  comparison  is  made  by  find- 
ing the  product  of  their  square  roots  and  comparing  31  with  that 
number.     This  working  out  of  the  formula  gives  the  following: 

^x.y                  31                31        „  ^^ 
f= — ^^I  =  — H Z  = =^.9^ 

V-Loi?    \  S/    l/34     V'32    32.98 

The  work  described  is  easy  in  the  artificially  simple  example 
chosen  but  far  more  laborious  in  cases  where  the  average  is  not  a 
whole  number,  for  this  involves  multiplying  and  squaring  with 
numbers  having  decimal  fractions.  There  are  methods  for  doing 
this  that  involve  finding  the  deviations  from  a  whole  number 
near  to  the  average  and  then  correcting  the  work  to  allow  for  the 
differences  between  the  results  so  found  and  the  correct  results. 
These  methods  are  laborious  and  increase  the  chances  of  letting 
errors  of  computation  destroy  the  accuracy  of  the  work. 

A  Shorter  Method 
All  these  difficulties  may  be  avoided  by  a  method  which  it  is 
the  object  of  this  article  to  present,  and  which  gives  the  sums  of 
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the  products  and  the  sums  of  the  squares  of  the  deviations  directly 
from  the  squares  of  the  original  numbers.  It  does  not  involve 
arranging  the  series  in  order,  or  finding  the  separate  deviations, 
and  so  avoids  the  necessity  for  taking  into  account  the  plus  and 
minus  signs  of  deviations. 

This  method  is  based  on  considering  every  number  in  a  series 
as  being  equal  to  the  average  of  the  series  plus  a  plus  or  minus 
deviation  from  that  average.  Thus  10,  which  is  the  last  number 
in  the  first  series  of  the  illustrative  example  already  cited,  may  be 
considered  as  being  equal  to  the  average  of  the  series,  or  6,  plus 
the  deviation  4. 

If  now  we  find  the  sum  of  the  squares  of  the  numbers  in  a 
series  and  subtract  from  it  the  product  found  by  multiplying  the 
square  of  the  average  of  the  series  by  the  number  of  cases,  the 
remainder  will  be  the  sum  of  the  squares  of  the  deviations  from 
the  average.  Suppose,  for  example,  that  the  series  consists  of 
the  two  numbers  4  and  8.  Their  average  is  6  and  the  deviations 
from  it  are  —2  and  +2,  the  sum  of  the  squares  of  which  equals  8. 
But  it  is  also  true  that  the  squares  of  these  numbers  are  16  and  64 
with  a  sum  of  80.  If  we  subtract  from  this  the  square  of  the 
average,  or  36.  multiplied  by  the  number  of  cases,  or  2,  we  again 
get  8  as  a  result. 

The  Formula 

Utilizing  this  principle  we  may  compute  coefficients  of  correla- 
tion directly  from  the  products  and  squares  of  the  items  of  the 
two  series  without  finding  the  separate  deviations.  Before  writing 
the  iormula  certain  abbreviations  may  be  set  down  as  follows: 

Sub.  =  the  first,  or  subject  series 

Rel.  =  the  second,  or  relative  series 

Tot.  =  the  total  of  a  series,  the  sum  of  its  items 

Av.  =  the  average  of  a  series 

The  formula  expressed  in  these  abbreviations,  and  also  using 
the  letters  5  and  R  for  subject  and  relative,  is  as  follows: 

Sum  of  products  of  subject  and  relative  items 

minus 
av.  of  subject  items  X  tot.  of  relative  items 

Sum  of  squares  of  sub.  items         Sum  of  squares  of  rel.  items 

minus  y\  minus 

av.  X  total   of   these   items        av.    X  total  of  these  items 
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It  may  be  more  easily  written  but  perhaps  less  easily  remembered 
if  expressed  as  follows: 

XS.'ER 
ISS.R 

iV 


252- 


(25)2 


N 


(222)* 


2222— 


N 


The  application  of  this  formula  to  the  example  already  worked 
by  the  conventional  method  i«  as  follows: 


Sub. 

Rel 

Sub.2 

Rel.2 

Sub.  X  Rel 

3 

6 

9 

36 

18 

4 

5 

16 

25 

20 

5 

7 

25 

49 

35 

8 

11 

64 

121 

88 

10 

11 

100 

121 

110 

40 


214 


352 


Total        30 

Average      6  8 

First  correction  =  271 -(6X40)  =  271-240=31 

Second  correction  =  214-(3X60)  =  214-180  =  34 

Third  correction  =  352  -  (8  X  40)  =  352  -  320  =  32 


271 


31 


31 


=0.94 


1/34  X 32    32.98 


An  important  feature  of  this  method  is  that  t  facilitates 
the  use  of  mechanical  aids  to  computation.  The  work  consists 
almost  entirely  of  taking  squares  from  tables  and  multiplying  and 
adding,  which  are  the  operations  most  easily  done  by  machines. 
It  eliminates  the  long  series  of  subtractions  which  are  not  readily 
done  by  the  help  of  machines.  It  also  eliminates  the  necessity 
for  watching  for  unlike  signs  in  the  multiplication  of  deviations, 
and  making  the  series  of  corrections  to  allow  for  the  differences 
between  the  guessed  averages  and  the  true  averages  of  the  series. 

Experience  in  using  this  formula  in  dealing  with  the  problems 
arising  in  the  regular  work  of  a  statistical  office  indicates  that  it 
reduces  by  something  more  than  one-half  the  time  necessary  to 
compute  correlations  from  short  series  of  20  or  30  pairs  of  items. 
On  longer  series  the  saving  is  greater  and  on  distribution  tables 
involving  some  thousands  of  cases,  grouped  in  about  100  compart- 
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ments,  it  cuts  the  time  to  one-third  or  one-fourth  of  that  required 
by  the  old  methods.  Almost  more  important  is  the  fact  that  its 
use  very  greatly  reduces  the  number  of  errors  made  in  working 
out  the  computations. 

The  use  of  the  theorem  that  the  sum  of  the  squares  of  the 
deviations  of  a  series  of  items  away  from  their  average  is  equal 
to  the  sum  of  the  squares  of  the  items  minus  the  product  of  the 
total  of  the  series  and  its  average  will  greatly  facilitate  the  finding 
of  the  standard  deviation.  Those  who  are  interested  in  seeking 
a  further  explanation  of  the  theorem  itself  will  find  it  in  consider- 
ing each  item  of  the  series  as  a  binomial  consisting  of  the  average 
plus  a  plus  or  minus  deviation  from  the  average.  By  squaring  a 
series  of  such  binomials  and  adding  them,  it  will  be  found  that 
the  middle  terms  cancel  out,  leaving  the  squares  of  the  average 
and  the  squares  of  the  deviations.  A  similar  procedure  in  mul- 
tiplying the  items  of  the  two  paired  series  will  explain  the  process 
followed  in  deriving  the  numerator  of  the  fraction  given  in  the 
new  formula. 


TEXTBOOKS:  THEIR  COST  AND  IMPROVEMENT 

It  is  generally  agreed  that  the  results,  the  methods,  and  the 
spirit  of  research  ought  to  be  evident  in  school  practice.  As 
long  as  they  are  confined  to  remote  laboratories  and  described 
in  technical  treatises,  they  merely  exist  in  a  vacuum.  We,  there- 
fore, seek  to  bring  them  to  the  attention  of  those  who  supervise 
and  teach.  But  this  is  not  sufficient.  The  practice  of  teachers  is 
largely  controlled  by  the  textbook.  As  is  frequently  pointed  out, 
it  plays  a  unique  part  in  the  aflairs  of  the  American  school.  It  is, 
therefore,  highly  important  that  the  textbook  should  exemplify 
the  best  that  competent  research  has  estabhshed.  There  should 
be  an  easy  transfer  of  the  findings  of  investigators  to  the  content 
of  schoolbooks.  It  is  not  enough  to  train  the  teacher  in  the  spirit 
of  research;  the  textbook  should  be  the  concrete  fruition  of 
research. 

This  is  not  often  true.  Constant  revision  of  existing  texts  and 
frequent  pubHcation  of  new  ones  can  only  be  accomplished  if 
boards  of  education  set  aside  considerably  more  money  for  books 
than  they  now  do.  There  must  not  only  be  a  larger  fund  for 
teachers'  salaries,  but  there  must  also  be  a  larger  textbook  fund. 
In  fact,  the  whole  scheme  of  universal  public  education  can  no 
longer  be  effectively  maintained  without  going  to  new  and  higher 
cost  levels. 

Expenditures  for  textbooks  in  this  country  are  very  small, 
considering  their  importance  in  the  teaching  process.  They  cost 
rather  more  than  perfumery  and  cosmetics  and  rather  less  than 
chewing  gum.  In  1913,  the  aggregate  of  sales  for  elementary  and 
high-school  use  was  a  little  over  $14,000,000.  This  amounted  to 
78  cents  for  each  child  enrolled  in  the  public  schools,  to  57  cents 
for  each  child  on  the  census  rolls,  and  to  somewhat  less  than  1 5 
cents  per  capita  of  the  population.  Doubtless,  the  figures  are  a 
little  higher  now,  but  we  all  know  that  due  to  long-time  contracts, 
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the  cost  of  textbooks  has  been  held  down.  At  any  rate,  these 
j&gures  are  of  such  an  order  of  magnitude  that  no  change  which 
could  possibly  have  taken  place  in  the  last  six  or  seven  years  would 
make  any  material  difference  in  our  argument.  Average  condi- 
tions for  1914  in  21  states  showed  that  if  every  pupil  who  entered 
the  first  grade  remained  through  the  eighth  grade,  a  complete 
layout  of  new  basic  textbooks  for  his  eight-year  course  would  cost 
but  $9.40.  It  is  said  that  we  are  an  extravagant  people,  that  we 
are  passing  through  a  period  of  wild  expenditure;  but  here  is  a 
place  where  our  frugal  nature  apparently  asserts  itself.  In  the 
midst  of  the  riotous  Hving  in  which  everyone  except  school  teachers 
is  supposed  to  be  indulging,  we  are  spending  15  cents  a  piece — 
or  may  it  be  25  cents? — for  the  instruments  of  instruction  with 
which  we  equip  our  schools. 

It  is  not  generally  known,  however,  that  our  expenditures  for 
this  purpose  are  so  meager.  Exaggerated  ideas  on  this  subject 
seem  to  persist.  In  Illinois,  for  example,  in  1912  wide  publicity 
was  given  to  an  estimate  that  in  that  state  the  textbook  profit 
amounted  to  $1,000,000  per  year.  As  a  matter  of  fact,  the  total 
annual  volume  of  business  in  Illinois  was  at  that  time  only  about 
$750,000.  Again,  in  connection  with  the  political  handling  of 
the  textbook  question  in  Kansas  a  few  years  ago,  wild  estimates 
of  what  might  be  "saved  to  the  tax  payers"  were  made — estimates 
which  sometimes  exceeded  the  value  of  all  the  books  sold  in  that 
state. 

As  a  matter  of  fact,  the  cost  of  textbooks  is  so  small  that  the 
real  problem  is  not  to  cheapen  them  but  to  improve  them  and  to 
increase  the  number  available  for  each  child.  To  do  this  we  shall 
need  to  spend  much  more.  Perhaps  instead  of  remaining  on  the 
chewing  gum  basis,  we  shall  have  to  lay  out  as  much  as  we  spend 
for  soda  water.  For  publishers  cannot  afford  to  incorporate  new 
and  better  features  into  their  books  because  the  price  of  textbooks 
has  been  "standardized."  Boards  of  education  are  willing  to  pay 
only  about  32  cents  for  a  speller,  90  cents  for  a  history,  or  $1.00 
for  a  geography.  With  the  introduction  of  free  textbooks  and 
the  utilization  of  the  large  purchasing  power  of  state,  municipal, 
and  county  governments,  this  pseudo-standardization  has  been 
brought  about — a  condition  whereby  a  speller  is  a  speller  and  a 
history  a  history  no  matter  what  their  covers  may  contain. 
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Investigations  looking  toward  the  improvement  of  textbooks 
are  under  way  in  a  number  of  places  and  it  is  certain  that  this 
type  of  investigation  will  become  more  prevalent  when  its  impor- 
tance is  better  understood.  Titles  of  recent  masters'  and  doctors' 
theses  make  clear  the  fact  that  in  departments  of  education  in 
colleges  and  universities,  the  two  fields  of  research  which  are 
regarded  as  most  significant  are  the  study  of  teachng  methods  and 
the  analysis  of  curriculums.  In  the  public  schools,  however,  it  is 
equally  clear  that  the  teaching  methods  and  curriculum  actually 
put  into  practice  are  the  methods  and  curriculum  of  the  textbook. 
To  be  effective,  therefore,  it  is  in  the  textbooks  that  the  new 
methods  and  curriculums  must  be  expressed. 

It  has  been  pointed  out  that  three  financial  obstacles  stand 
in  the  way:  an  inverted  sense  of  values,  an  exaggerated  notion  of 
textbook  costs,  and  a  wrong-headed  idea  of  efliciency.  The 
inverted  sense  of  values  is  evident  in  our  vast  expenditures  for 
trumpery  while  we  each  contribute  the  price  of  a  movie  ticket 
that  twenty  million  pupils  may  have  the  benefit  of  the  most 
effective  instruments  of  instruction.  The  exaggerated  notion  of 
costs  is  locally  present  wherever  textbooks  instead  of  being  pro- 
vided at  public  expense  are  purchased  by  parents;  and  the  notion 
has  also  become  generally  current  because  of  political  rodomon- 
tade and  reports  (true  and  false)  of  crooked  adoptions.  The 
wrong-headed  idea  of  efficiency  is  due  to  lay  purchasing  agents 
whose  aim  is  to  make  a  financial  record  and  who  judge  the  value 
of  a  book  not  by  its  contents  but  by  the  class  to  which  it  belongs. 

For  these  reasons,  although  we  are  in  the  midst  of  researches 
whose  results  ought  to  be  at  once  reflected  in  better  textbooks, 
better  textbooks  are  slow  to  appear.  If  it  is  a  day  of  promise  in 
research,  it  is  also  a  day  of  stagnation  in  textbook  making.  The 
results,  the  methods,  and  the  spirit  of  research  will  never  become 
fully  applicable  in  the  work  of  the  schools  until  in  addition  to  their 
apprehension  by  teachers,  they  find  expression  in  the  books  whch 
are  placed  in  ihe  hands  of  pupils. 

B.  R.  B. 
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Strayer,  George  D.,  Engelhardt,  N.  L.,  and  Hart,  F.  W.    General 

report  on   buildings  and  grounds   of  Delaware,  Wilmington,   Delaware: 

Service  Citizens  of  Delaware,  1919.     222  pp. 

One  or  more  of  the  authors  of  the  report  visited  every  school  house  in 
Delaware,  rated  it  by  means  of  the  well-known  Strayer  score  card  for  school 
buildings,  made  observations  concerning  those  features  of  each  building  to 
which  they  thought  the  attention  of  the  people  concerned  should  be  called, 
and  submitted  a  complete  report  to  the  Service  Citizens  of  Delaware.  The 
printed  report  gives  representative  cases  for  each  type  of  building.  Concern- 
ing each  case  reported  there  appear,  first,  the  comments  concerning  the 
special  needs  of  the  particular  building;  second,  the  scores  given  the  building 
on  (a)  site,  (b)  building,  (c)  service  systems,  (d)  classrooms,  and  (e)  special 
rooms;  and  third,  in  most  cases  a  photograph.  Chapter  I  contains  a  rather 
full  statement  of  the  characteristics  of  a  modern  school  building.  Part  II 
gives  a  series  of  definitions  of  so-called  minimum  standards  for  each  aspect 
of  a  school  building  listed  on  the  score  card,  and  tables  of  distribution  of 
Delaware's  buildings  by  counties  according  to  scores  on  each  of  the  main 
headings. 

To  the  general  reader  residing  outside  of  Delaware,  the  most  significant 
part  of  the  report  is  Chapter  I.  In  it  is  given  a  brief  but  complete  description 
of  the  essentials  of  a  modern  school  building.  The  language  is  simple  and 
direct.  This  splendid  summary  of  modern  requirements  in  school  buildings 
should  prove  of  great  value  to  school  boards  as  well  as  to  superintendents 
at  any  time;  but  it  is  particularly  timely  just  now  when  so  many  communities 
of  all  types  are  inaugurating  school  building  programs.  These  modern 
requirements  are  naturally  far  in  advance  of  actual  building  conditions  not 
only  in  Delaware  but  also,  no  doubt,  in  all  other  states.  Nevertheless,  some 
buildings  in  Delaware  are  found  to  measure  up  well  with  these  requirements, 
and  there  is  a  delightful  assumption  on  the  part  of  the  authors  that  all  the 
districts  of  Delaware  will  naturally  wish  to  reach  these  high  standards  when 
they  are  made  aware  of  them. 

To  the  student  of  education  there  is  much  food  for  thought  in  Part  II. 
The  attempt  to  define  minimum  standards  with  respect  to  each  subhead 
appearing  on  the  score  card  brings  out  both  the  utility  and  the  diflaculty  of 
such  an  undertaking.  The  authors  have  met  the  problem  of  difference  in 
judgment  which  is  bound  to  arise  in  respect  to  many  of  the  standards  by 
adopting  the  term  "Optional"  for  many  of  the  most  debatable  essentials. 
For  example,  under  "Seats  and  Desks,"  they  give  as  minimum,  "Should  be 
individual,  adjustable,  and  adjusted,"  but  they  add  as  optional,  "Movable 
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chairs  arc  preferable  to  screwed-down  seats."  In  spite  of  the  inevitable 
differences  of  opinion  concerning  the  definitions  of  these  minimum  standards, 
the  well-classified  and  carefully  worded  definitions  will  prove  very  helpful 
indeed  as  a  practical  guide. 

The  genuine  value  of  a  score  card  as  a  method  of  evaluating  buildings  is 
clearly  brought  out  in  the  distribution  tables.  Here  we  see  a  figure  standing 
for  the  total  score  of  a  building,  just  as  a  figure  stands  for  the  score  of  a 
thoroughbred  animal.  One  building  can  be  compared  with  another,  either 
as  a  building  or  in  respect  to  any  of  its  aspects.  Comparison  can  also  be 
made  between  the  whole  set  of  Delaware  buildings  and  any  other  group  of 
buildings  measured  by  the  same  score  card.  Probably  no  other  method  of 
stating  building  facts  could  have  been  as  effective  in  bringing  the  state  to  a 
realization  of  the  seriousness  of  its  building  situation. 

The  chapters  dealing  with  the  individual  buildings  should  prove  of 
great  value  to  the  districts  concerned.  Even  though  the  situation  revealed 
is  often  deplorable,  the  account  is  only  rarely  couched  in  terms  of  rebuke. 
The  several  districts  cannot  help  feeling  that  the  survey  was  made  for  a  con- 
structive purpose,  and  will  undoubtedly  utilize  many  of  the  suggestions  in 
constructing  new  buildings. 

F.  J.  K. 

Obrien,    Francis    P.      The    high    school    failures.      (Teachers    College 

Contributions  to  Education,  No.  102.)     New  York:  Teachers  College, 

Columbia  University,  1919.     97  pp. 

The  free  public  high  school  enrolls  about  85  percent  of  all  the  secondary 
school  pupils  in  the  United  States.  That  fact  alone  makes  appropriate  a 
study  of  the  products  in  terms  of  success  or  failure  in  attaining  the  standards 
set  by  particular  schools.  This  book  is  such  a  study.  In  it  the  author 
analyzes  the  cumulative  records  of  6,141  pupils  in  eight  different  high  schools 
in  New  York  and  New  Jersey,  in  order  to  determine  the  significant  facts 
relative  to  pupils  who  fail.  For  this  group  of  pupils  he  has  answered  defi- 
nitely and  conclusively  these  questions  which  are  stated  as  chapter  headings: 

"How  extensive  are  the  failures  of  the  high  school  pupils?" 

"What  basis  is  discoverable  for  a  prognosis  of  the  occurrence  or  the 
number  of  failures?" 

"How  much  is  graduation  or  the  persistence  in  school  conditioned  by 
the  occurrence  or  by  the  number  of  failures?" 

"Are  the  school  agencies  employed  in  remedying  the  failures  adequate 
for  the  purpose?" 

"Do  the  failures  represent  a  lack  of  capability  or  of  fitness  for  high 
school  work  on  the  part  of  those  pupils?" 

"What  treatment  is  suggested  by  the  diagnosis  of  the  facts  of  failure?" 

Some  of  the  more  important  findings  are: 

1.  The  percent  of  recorded  and  virtual  but  unrecorded  failures  is  66. 

2.  Of  the  graduating  pupils  58 . 1  percent  fail  one  or  more  times. 

3.  The  number  of  failures  increases  for  the  first  four  semesters,  with 
one-third  to  one-half  of  the  pupils  failing  in  each  semester  to  the  seventh. 
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4.  Of  all  the  failures  86  percent  occur  for  pupils  from  15  to  18  years  of 
age,  inclusive. 

5.  Mathematics,  Latin,  and  English  combined  furnish  60  percent  of  the 
total  failures,  but  English  furnishes  many  rather  because  of  large  enrollment 
than  because  of  difliculty.  The  percent  of  failures  of  pupils  taking  the 
subject  is  greatest  for  mathematics,  Latin,  and  German. 

6.  The  younger  entering  pupils  have  fewer  failures  and  are  more  certain 
of  graduation. 

7.  The  first  year's  record  has  real  prognostic  value  for  pupils  who  remain 
in  school  more  than  three  semesters. 

8.  As  many  graduates  as  non-graduates  fail — 31 .5  percent  in  each  case. 

9.  "Failure  is  probably  not  a  prime  cause  of  dropping  out  for  most  of 
the  non-graduates,  as  80  percent  have  only  five  failures  or  fewer."  (p.  58) 

10.  "The  worst  consequences  of  failure  are  perhaps  in  acquiring  the 
habit  of  failing  and  in  coming  to  accept  oneself  as  a  failure."  (p.  58) 

11.  "The  emphasis  placed  on  repetition  is  excessive  and  the  faith  dis- 
played in  it  by  school  practice  is  unwarranted  by  the  facts."  (p.  74) 

12.  The  number  of  pupils  who  lack  native  ability  is  small. 

Thus  the  author  does  not  regard  lack  of  intellectual  ability  as  being  a 
particularly  potent  cause  of  failure.  He  rightly  points  out  that  the  pupil  is 
only  one  of  the  factors  contributing  to  failure.  His  emphasis  in  the  matter 
of  obviating  failure  is  placed  upon  subject  matter  and  the  aims  of  teaching. 

In  a  sense  the  author  is  right.  From  the  very  nature  of  the  case,  as 
Burk  p>oints  out,  there  can  be  no  misfit  children.  There  may  be  misfit 
courses  of  study,  misfit  teachers,  or  a  misfit  educational  philosophy,  but 
there  can  be  no  misfit  child  because  all  these  must  be  fitted  to  the  child. 
As  well  say  that  a  person  does  not  fit  his  clothes  as  to  say  that  a  child  does 
not  fit  the  school. 

On  the  other  hand,  one  should  point  out  that  the  trend  of  thought  today 
is  in  the  direction  of  emphasizing  intelligence  as  an  important  cause  of 
failure  and  of  leaving  school.  Professor  Terman  and  his  students  are  bring- 
ing to  bear  a  large  amount  of  data  on  this  question.  They  are  doing  so  by 
actually  administering  intelligence  tests  to  the  children  who  fail  as  well  as  to 
those  who  do  not.  One  may  point  out  that  Dr.  Obrien's  conclusion  that 
failing  pupils  "lack  neither  ability  nor  earnestness"  is  not  based  on  evidence 
as  direct  and  convincing  as  is  the  evidence  gathered  from  actual  testing  for 
intelligence. 

As  remedies  for  failure,  Dr.  Obrien  suggests,  among  other  things:  a 
functioning  psychology;  whole-hearted  purposeful  responses  from  the  pupil; 
properly  selected  student  advisors;  a  high  degree  of  flexibility  in  the  curricu- 
lum; the  reduction  of  subject  matter  to  smaller  units;  provision  for  directed 
study;  and  the  collection  and  interpretation  of  useful  facts.  Some  of  these 
suggestions  are  important,  others  are  rather  naive;  and  all  are  more  or  less 
without  foundation  in  evidence. 

As  needed  analyses  of  this  kind  are  made  and  the  unescapable  facts  of 
failure  are  produced,  the  important  question  for  secondary  education  is  to 
determine  what  is  to  be  done  about  it.  Is  the  high  school  to  be  a  selective 
institution  for  the  purpose  of  educating  the  leaders  of  society?    Or  is  it  to 
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be  an  institution  where  every  youth  who  can  profit  from  secondary  instruc- 
tion is  enrolled?  Just  now  we  are  at  the  parting  of  the  ways  with  the  tradi- 
tional sign  post  pointing  to  a  continuance  of  absolute  uniformity.  The  new 
re-interpreted  social  theory  demands  that  each  individual  shall  live  as  fully 
as  we  know  how  to  permit  him.  In  practice,  therefore,  curriculums  must  be 
devised  so  as  to  find  out  the  interests,  ideals,  abilities,  and  even  the  prejudices 
of  pupils;  and  then  provision  must  be  made  for  the  full  development  of 
interests,  idealS;  and  abilities. 

P.  E.  Belting 
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IV.  English 
A.  Composition 
Harvard-Newton    Composition   Scale.     The   Harvard-Newton    Composition   Scale 
consists  of  four  separate  scales,  one  for  each  form  of  discourse:  argumentation, 
description,  exposition,  and  narration.    Each  of  the  scales  consist  of  six  composi- 
tions written  by  eighth-grade  pupils  and  arranged  in  order  of  merit  as  determined 
by  the  marks  assigned  by  teachers,  rating  them  as  eighth-grade  compositions. 
This  scale  has  been  used  in  the  first-year  classes  in  the  high  school. 
Publisher:  Harvard  University  Press,  Cambridge,  Massachusetts. 
References:  Ballou,  F.  W.     Scales  for  the  measurement  of  English  composition. 
(Harvard   Newton  Bulletin  No.   2)    Cambridge,   Massachusetts:  Harvard 
University  Press,  1914. 
The  derivation  and  use  of  the  scale  is  described. 

Stoddard,  W.  E.  "Comparison  of  the  Hillegas  and  Harvard-Newton  scales  in 
English  composition,"  Pedagogical  Seminary,  23:498-501,  December  1916. 

Second  annual  conference  on  educational  measurements,  April,  1915,  p.  115  ff. 
(Indiana  University  Bulletin,  v.  13,  no.  11,  October,  1915). 

An  account  of  the  use  of  this  scale  in  the  first  year  of  the  high  school  is  given. 

Hillegas'  Scale  for  the  Measurement  of  the  Quality  in  English  Composition  for  Yoong 
People.  This  scale  consists  of  ten  compositions  ranging  from  an  artificial  pro- 
duction, whose  scale  value  is  zero,  to  the  tenth  composition,  whose  scale  value  is 
9.3.  Three  of  the  ten  compositions  are  artificial  productions,  five  were  written 
by  high  school  pupils,  and  the  remaining  two  by  college  freshmen.  No  two  were 
written  on  the  same  topic  and  they  vary  greatly  in  length  and  type.  Each  degree 
of  merit  is  represented  by  only  one  composition. 
Publisher:  Bureau   of   Publications,    Teachers    College,    Columbia    University, 

New  York  City. 
References:  Courtis,  S.  A.     Tthe  Gary  public  schools:  measurement  of  classroom 

products.    New  York:  General  Education  Board,  1919,  p.  227. 

An  account  of  the  use  of  this  scale  in  the  high  school  is  given  here  and  also  in  the  following 
reieience. 

229 


230  JOURNAL  EDUCATIONAL  RESEARCH         Vol.  1,  No.  3 

An  educational  survey  of  Janesville,  Wisconsin.      Madison,   Wisconsin:   State 

Department  of  Public  Instruction,  1918,  p.  287. 
Gunther,  Charles.     "My  experience  with  the  Hillegas  scale,"  English  Journal, 

2:535-42,  November,  1919. 

Describes  a  series  of  eaperiments  carried  on  by  four  Uachen  in  the  use  of  the  Hillegas  scale. 
Mr.  Gunther  in  his  conclusion  definitely  states  that  through  the  Hillegas  or  some  similar  scale  greater 
uaiformity  is  gained  than  through  a  percent  scale. 

Hillegas,  Milo  B.     "Hillegas  scale  for  measurement  of  English  composition," 

Teachers  College  Record,  13u331-84,  September,  1912. 
Johnson,  F.  W.     "The  Hillegas-Thorndike  scale  for  measuring  the  quality  in 

English  composition  by  young  people,"  School  Review,  21 :39-49,  January,  1913. 
Kayetz,  Isidor.    "A  critical  study  of  the  Hillegas  composition  scale,"  Pedagogical 

Seminary,  21:559-77,  December,  1914. 

Toe  first  part  of  the  article  is  concerned  with  the  scale  itself;  the  second  part  devoted  to  a 
criticism  by  the  author  and  others.     References  relative  to  the  scale  follow. 

Parker,  F.  E.     "Value  of  measurements,"  English  Journal,  8:203-17,  April,  1919. 

A  criticism  *n  the  use  of  the  Hillegas  scale  by  a  subcommittee  of  the  Detroit  English  Club. 
S.  A.  Courtis  discusses  the  "Use  of  the  Hillegas  Scale"  in  the  second  part  of  this  article. 

School  report  of  the  town  of  Southington,  Connecticut,  1917,  p.  12. 
Stoddard,  W.  E.     "Comparison  of  the  Hillegas  and  Harvard  Newton  scales  in 
English  composition,"  Pedagogical  Seminary,  23:498-501,  December,  1916. 

Moet  valuable  for  its  criticism  of  the  Hillegas  scale. 

Hiorndike,  E.  L.  "Notes  on  the  significance  and  use  of  the  Hillegas  Scale  for 
measuring  the  quality  of  English  composition,"  English  Journal,  2:551-561, 
November,  1913. 

Minnesota  English  Composition  Scale. 

R^erence:  Van  Wagenen,  M.  J.  "The  Minnesota  English  composition  scale,  its 
derivation  and  validity."  To  be  published  in  the  first  volume  of  the  Journal 
of  Educational  Research. 

Naeeau  County  Supplement  to  the  Hillegas  Scale.  This  scale  is  a  simplification  and 
improvement  of  the  original  Hillegas  Composition  Scale.  It  consists  of  a  series  of 
compositions  written  under  controlled  conditions  and  arranged  in  order  of  general 
merit. 

Publisher:  Bureau  of  Publications,  Teachers  College,  Columbia  University,  New 
York  City.  Also  obtainable  from  Bureau  of  Educational  Research,  Univer- 
sity of  Illinois,  Urbana,  Illinois. 
References:  Theisen,  W.  W.  "Improving  teachers'  estimates  of  composition 
specimens  with  the  aid  of  the  Trabue  Nassau  County  scale,"  School  and 
Society,  7:143-150,  February  2,  1918. 

Discusses  the  outcomas  of  an  experiment  prompted  by  the  question:  "Can  teachws  improve 
their  judgment  of  the  merit  of  compositions  through  use  of  the  scale?" 
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Trabue,  M.  R.    "Supplementing  the  Hillegas  composition  scale,"  Teachers  College 
Record,  18:51-84,  January,  1917. 

Reasons  for  constructing  tb«  Nassau  County  supplement,  iti  advantages  over  the  Hillegas 
•cale.  Table  V  lists  the  "estimates  of  quality  to  be  expected  from  high  achool  seniors  and  sophomores" 
in  the  use  of  the  Hillegas  scale. 

An  account  of  the  use  of  scale  in  the  high  school  may  be  foimd  in  the  following: 
Report  of  a  Survey  of  Public  Education  in  Na<;'au  County,    New  York.    Albany, 

New  York:  University  of  the  State  of  Nc,  York,  1918,  p.  149  fif. 
Report  of  a  survey  of  the  school  system  of  St.  Paul,  Minnesota,  1917,  p.  456. 

Scores  are  given  for  St.  Paul,  Minnesota;  Mobile  and  Mobile  County,  Alabama;  Nassau 
County,  and  South  River,  New  York;  Lead,  South  Dakota. 

Topeka  Scale  for  Judging  Compositions.    This  scale  was  devised  by  the  English 

department  of  the  high  school  in  Topeka,  Kansas. 

Address:  Carmie  S.  Wolfe,  High  School,  Topeka,  Kansas. 

Reference:  "The  Topeka  scale  for  judging  compositions,"  Bulletin  of  the  Illinois 

Association  of  Teachers  of  English,  v.  9  no.  6.  March,  1,  1917. 

Scale  reproduced  and  derivation  described.  For  a  copy  of  the  bulletin  address  Professor  H.  G. 
Paul,  University  of  Illinois,  Urbana,  Illinois. 

Willing's  Scale  for  Measuring  Written  CompositioB.    This  scale  consists  of  eight 
compositions  arranged  in  order  of  both  "form"  and  "story  value."    All  of  the 
compositions   were   written   by  school   children   under  controlled   conditions. 
This  scale  may  be  used  in  grades  iv  to  xn  inclusive. 
Publisher:  Bureau  of  Educational  Research,  University  of  Illinois,  Urbana, 

Illinois. 
Reference:  Willing,  M.  H.    "Measurement  of  written  composition  in  grades  rv 

to  vin,"  English  Journal,  7:193-202,  March,  1918. 

Considers  the  derivation  of  the  test,  also  its  giving  and  scoring.  Although  this  scale  was 
designed  for  use  in  the  upper  grades  of  the  elementary  school,  it  can  b«  used  profitably  in  the  high  • 
school. 

B.  Copying 

Boston  Test  in  Accurate  Copying.    Test  was  prepared  by  the  committee  on  standards 
in  English.    It  was  given  to  first-year  pupils. 
Reference:  English:  determoning  a  standard  in  accurate  copying.   (Bulletin  No.  6  of 

the  Department  of  Educational  Investigation  and  Measurement,  Boston 

Public  Schools,  1916). 

This  bulletin  consists  of  a  report  on  the  Test  in  Accurate  Copying  given  to  4,494  first-year  Ugh 
school  pupils  in  November,  1914.    Test  is  reproduced. 

Kansas  City,  Missouri,  public  schools,  bulletin  no.  t  of  the  Bureau  of  Research 
and  Efficiency,  February,  1916,  p.  55. 

Analysis  of  errors  made  in  Kansas  City,  Missouri,  by  ages  and  grades.  The  teat  also  with 
directions  for  giving  and  scoring  are  given. 
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C.  Grammar  and  Punctuation 
Clemens'  Grammar  Test.    A  test  consisting  of  thirteen  sentences  in  which  the  pupil  is 
asked  to  make  a  choice  between  the  correct  and  incorrect  words.     This  test  is 
based  on  E.  C.  WooUey's  Handbook  of  Composition. 

Address:  A.  H.  Clemens,  Principal  of  High  School,  Rochester,  Minnesota. 
Reference:  Report  of  the  board  of  education  of  Rochester,  Minnesota,  1912-1918,  p.  40. 

The  test  is  reproduced,  with  a  key  to  the  sections  in  WooUey's  Handbook.    TenUtire  sUndard 
scores  are  also  given. 

Starch's  Grammatical  Scales.  Starch  has  devised  three  scales  (A,  B,  and  C)  to  meas- 
ure a  pupil's  ability  to  use  correctly  certain  language  forms. 

Starch's  Tests  for  Measuring  Grammatical  Knowledge.  The  three  tests  in  this  series 
consist  of  selections  in  which  the  pupil  is  asked  to  indicate  certain  parts  of  speech 
or  certain  inflected  forms. 

Publisher:  University  Cooperative  Company,  Madison,  Wisconsin. 
References:  Starch,  D.    Educational  measurements,  New  York:  Macmillan,  1916. 

See  Chapter  VII  entitled  "The  measurement  of  ability  in  English  grammar,"  for  a  reproduction 
of  the  tests  and  standards. 

Starch,  Daniel.     "The  measurement  of  achievement  in  English  grammar," 
Journal  of  Educational  Psychology,  6:615-26,  December,  1915. 
Clemens'  Punctuation  Test.    A  list  of  twenty-eight  sentences  which  are  to  be  punc- 
tuated.    Based  on  E.  C.  WooUey's  Handbook  of  Composition. 
Address:  A.  H.  Clemens,  Principal  of  High  School,  Rochester,  Minnesota. 
Reference:  Report  of  the  board  of  education  of  Rochester,  Minnesota,  1912-1918, 
p.  42. 
The  test  with  a  key  to  the  sections  in  the  Handbook  is  reproduced. 

Starch's  Punctuation  Scale.    This  scale  consists  of  a  series  of  groups  of  sentences  which 

are  to  be  punctuated.    The  groups  are  arranged  in  order  of  difficulty.     It  will  be 

useful  in  the  high  school. 

Publisher:  University  Cooperative  Company,  Madison,  Wisconsin.  Also  obtain- 
able from  the  Bureau  of  Educational  Research,  University  of  Illinois,  Urbana, 
Illinois. 

References:  Starch,  Daniel.  Educational  measurements.  New  York:  Macmillan 
Company,  1916. 

See  Chapter  VII  entitled  "The  measurement  of  ability  in  English  grammar,"  for  a  reproduction 
of  test,  and  standards. 

Starch,  Daniel.  "The  measurement  of  achievement  in  English  grammar," 
Journal  of  Educational  Psychology,  6:615-26,  December,  1915. 

D.  Language 
Trabue's  Completion-Test  Language  Scales.    These  scales  are  composed  of  "com- 
pletion sentences"  which  are  arranged  in  order  of  difficulty  from  the  very  simple 
to  the  very  difficult.    There  are  two  scales  for  the  high  school,  L  and  M. 
Publisher:  Bureau   of   Publications,   Teachers   College,    Columbia    University, 
New  York  City.    Also  obtainable  from  Bureau  of  Educational  Research, 
University  of  Illinois,  Urbana,  Illinois. 
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'References:  Trabue,  M.  R.  Completion-test  language  scales.  (Teachers' 
College,  Columbia  University  Contributions  to  Education,  No.  77)  New 
York:  Teachers  College,  Columbia  University,  1916. 

The  author  states:  "This  monograph  is  the  report  of  aa  attempt  to  derive  ont  or  more  scalcf 
for  the  measurement  of  ability  along  certain  lines  closely  related  to  language." 

Account  of  its  use  in  the  high  school  may  be  found  in: — 

Report  of  a  survey  of  public  education  in  Nassau  County,  New  York.     Albany, 

New  York:  University  of  the  State  of  New  York,  1918,  p.  177  ff. 
Report  of  a  survey  of  the  school  system  of  St.  Patd,  Minnesota,  1917,  p.  433  flf.,  table 

inserted  before  p.  453,  460,  487. 

E.  Spelling 
Ayres'  Spelling  Scale.  A  thousand  words  constituting  a  fundamental  English  vocabu- 
lary have  been  grouped  in  this  scale  according  to  their  spelling  difficulty  as  indi- 
cated by  the  percent  of  correct  spellings.  The  words  were  selected  from  four 
important  reports  on  the  frequency  with  which  words  are  used  in  letters,  news- 
paper articles,  the  English  Bible,  and  various  authors.  The  approximate  percent 
of  correct  spellings  to  be  expected  in  each  grade  is  shown  for  each  word.  Although 
not  intended  for  use  in  the  high  school  this  scale  has  been  used  by  some  above  the 
eighth  grade. 
Publisher:  Division  of  Education,  Russell  Sage  Foundation,  New  York  City. 

Also  obtainable  from  the  Bureau  of  Educational  Research,  University  of 

Illinois,  Urbana,  Illinois. 
References:  Ayres,  L.  P.     A  measuring  scale  for  ability  in  spelling.    New  York: 

Division  of  Education,  Russell  Sage  Foundation,  1915. 
Courtis,  S.  A.     The  Gary  public  schools:  measurement  of  classroom  products.    New 

York:  General  Education  Board,  1919. 
Scofield,  F.  A.     "Difficulty  of  Ayres'  spelling  scale  as  shown  by  the  spelling  of 

560  high  school  students,"  School  and  Society,  4:339-40,  August  26,  1916. 

Account  of  its  use  in  the  junior  high  school  and  senior  high  school,  Eugene,  Oregon. 

Scofield,  F.  A.  "An  experiment  in  spelling  in  the  Eugene  high  school,"  School 
and  Society,  5:299-300,  March  10,  1917. 

Buckingham's  Extension  of  the  Ayres'  Spelling  Scale.  This  extension  adds  509  words 
to  the  original  Ayres'  Spelling  Scale  making  a  scale  of  1,509  words.  The  additions 
are  mainly  at  the  more  difficult  end  of  the  scale  and  will  thus  add  to  its  value 
especially  for  grammar  grades  and  the  high  school.  Scale  is  for  use  in  grades 
II  to  IX. 

Publisher:  Bureau  of  Educational  Research,  University  of  Illinois,  Urbana, 
Illinois. 

Buckingham's  Spelling  Scale.  This  was  the  first  published  spelling  scale.  It  consisted 
of  fifty  words  very  carefully  evaluated  together  with  about  one  hundred  and 
twenty-five  supplementary  words.  The  scale  as  such  has  not  been  published 
separately.  Some  of  the  words  now  appear  in  the  Buckingham's  Extension  of  the 
Ayres'  Spelling  Scale  mentioned  above. 
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Publisher:  Not  obtainable. 

Reference:  Buckingham,  B.  R.    Spelling  ability:  its  measurement  and  distribution. 

(Teachers  College,   Columbia  University  Contributions  to  Educati(»i,  No. 

59).     New  York:  Teachers  College,  Columbia  University,  1913. 

Considers  the  derivation  of  scale.    Scale  is  reproduced. 

An   educational   survey   of  Janesville,   Wisconsin.    Madison,   Wisconsin:  State 
Department  of  Public  Instraction,  1918,  p.  272. 

Account  of  the  Buckingham  sixty-five  word  list  in  the  high  school. 

G>urti8'  Dictation  Spelling  Tests.    There  are  four  tests  in  this  series,  each  of  which 

contains  twenty  test  words  embedded  in  sentences. 
Publisher:  S.  A.  Courtis,  82  Eliot  Street,  Detroit,  Michigan. 
Reference:  Courtis,  S.  A.     The  Gary  public  schools:  measurement  of  classroom 
products.    New  York:  General  Education  Board,  1919,  pp.  87-92. 

Jones'  One  Hundred  Spelling  Demons.    This  is  a  list  of  the  one  hundred  words  most 
frequently  misspelled  by  children  in  the  elementary  school. 
Address:  W  F.  Jones,  University  of  South  Dakota,  Vermillion,  South  Dakota. 
Reference:  Jones,  W.  F.    Concrete  investigation  of  the  material  of  English  spelling 
Vermillion,  South  Dakota:  University  of  South  Dakota,  1914. 

This  is  an  account  of  the  investigation  in  which  list  was  secured. 

Monroe,  Walter  S.,  De  Voss,  J.  C,  and  Kelly,  F.  J.    Educational  tests  and  measure- 
ments.   Boston:  Houghton  Mifflin  Company,  1917,  p.  133. 

The  One  Hundred  Spelling  Demons  are  reproduced. 

Account  of  the  use  of  the  "Demons"  in  high  school  may  be  found  in  the 
following: 

Annual  report  of  the  Des  Moines  public  schools,  1915,  part  2,  p.  10  ff. 
Annual  report  of  the  public  schools  of  Johnstown,  Pennsylvania,  1918,  p.  111-113. 
Courtis,  S.  A.     The  Gary  public  schools:  measurement  of  classroom  products.    New 

York:  General  Education  Board,  1919,  p.  92  flf.,  414  flf. 

Jones'  Spelling  Demons  used  in  analyzing  misspelled  words  in  the  composition  of  eighth-grade 
children. 

School  report  of  the  town  of  Southington,  Connecticut,  1919,  p.  21. 

Annual  report  of  the  school  department  of  the  city  of  Pittsfield,  Massachmetts,  1916, 
p.  23-24. 
Monroe's  Timed  Sentence  Spelling  Test.    This  is  a  series  of  three  tests  each  of  which 

consists  of  fifty  words  taken  from  suitable  columns  of  the  Ayres'  Spelling  Scale 

and  embedded  in  sentences.    The  sentences  are  then  so  arranged  that  they  may  be 

dictated  at  approximately  the  normal  rate  of  writing  in  each  of  the  grades.    Test 

III  is  used  in  grades  vii  and  viii  and  in  the  high  school. 

Publishers:  Bureau  of  Educational  Research,  University  of  Illinois,  Urbana, 
Illinois. 

Monroe,  Walter  S.,  De  Voss,  J.  C,  and  Kelly,  F.  J.     Educational  tests  and  measure- 
ments.   Boston:  Houghton  Mifflin  Co.,  1917,  p.  119. 
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V.  Foreign  Languages 
Hcndschm't  Foreign  Language  Tests.     Series  of  four  short  tests  for  the  purpose  of 
discovering  types  of  learners  in  language  study. 
Address:  Charles  H.  Handschin,  Oxford,  Ohio. 

Referenct:  Handschin,  C.  H.  "A  test  for  discovering  types  of  learners  in  language 
study,"  Modern  Language  Journal,  3:1-4,  t)ctober,  1918. 

Tots  reproduced  and  directions  given. 

A.  French 

Heiiaion'a  French  Tests.     A  series  of  tests  in  French  similar  to  the  author's  Latin  tests. 
Publisher:  V.  A.  C.  Henmon,  University  of  Wisconsin,  Madison,  Wisconsin. 
Reference:  Henmon,  V.  A.  C.     "The  measurement  of  ability  in  French,"  Journal 
of  Educational  Research.     (To  appear  in  the  first  volume.) 

Starch's  French  Reading  Test.  This  test  is  composed  of  a  series  of  thirty  sentences 
arranged  roughly  in  the  order  of  increasing  difficulty.  The  sentences  were  from 
the  readings  usually  covered  in  the  first  year  of  the  high  school. 

Starch's  French  Vocabulary  Test.  The  test  is  composed  of  two  numbered  lists  of 
one  hundred  French  words  each  and  corresponding  lists  of  their  English  equiva- 
lents. The  pupil  is  asked  to  write  after  each  French  word  a  number  of  its  English 
equivalents. 

Publisher:  University  Cooperative  Company,  Madison,  Wisconsin. 
Reference:  Starch,  Daniel.     Educational  measurements.     New  York:  Macmillan, 
1916. 

In  Chapter  XIII  "The  Measurement  of  Ability  in  French"  the  French  voonbulary  and  sentence 
tests  ate  reproduced.     Derivation  is  described. 

Wiikins'  Predetermination  Test  in  French.  After  analyzing  language  ability  Mr. 
Wilkins  derives  a  test  for  French  which  consists  of  five  parts: 

(1)  seeing  and  writing 

(2)  hearing  and  writing 

(3)  seeing  and  speaking 

(4)  hearing  and  speaking 

(5)  grammatical  concepts. 

Reference:  Wilkins,  L.  A.  "Testing  for  ability  to  learn  a  foreign  language,"  Bul- 
letin of  High  Points  in  the  Work  of  the  High  Schools  of  New  York  City,  v.  1 , 
no.  2,  p.  5,  February,  1919;  no.  8,  p.  26,  October,  1919. 

A  discussion  of  the  test  and  scoring  is  followed  by  the  reproduction  of  the  test.     Results  are 
gives  in  the  October  Number. 

B.  German 

Starch's  German  Reading  Test.  This  test,  like  the  one  for  French,  is  composed  of  a 
series  of  sentences  arranged  roughly  in  the  order  of  increasing  difficulty.  The 
sentences  were  selected  from  first-year  texts  and  from  the  authors  usually  covered 
in  four  years  of  German. 


236  JOURNAL  EDUCATIONAL  RESEARCH        Vol.  1,  No.  3 

Starch**  German  Vocabulary  Tests.    Professor  Starch  states :  "The  test  is  composed  ©f 
two  sets  of  100  words  each.    Theee  words  are  selected  by  taking  the  &ret  word  on 
every  23rd  page  of  the  large  Muret-Sanders  Gensjuo^EngUsh  Dictiooary." 
Publisher:  University  Cooperative  Co.,  Madison,  Wisconsin. 
Reference:  Starch,  Daniel.     Educaiional  measurementt.    New  York:  Macmillan, 

1916. 

In  Chapter  XII:  "The  measurement  of  ability  in  G«iman"  tcits  are  reproduced. 

C.  Latin 
Brown's  Latin  Tests. 

1.  Connected  Latin  Test.    This  test  consists  of  a  connected  passage  of  Latin.    The 

pupils  are  given  a  specified  amount  of  time  in  which  to  interpret  and  write  In 
English  as  much  of  the  passage  as  possible. 

2.  Latin  Sentence  Test.     This  consists  of  a  series  of  Latin  sentences  ranging  from 

very  easy  to  very  difficult. 

3.  Formal  Latin  Vocabulary  Test.    A  list  of  words  occurring  in  the  Latin  Sentence 

Test. 

4.  Formal  Latin  Grammar  Test.    This  test  is  made  up  of  twenty  constructions  in 

Latin  sentences.    The  constructions  are  in  italics  and  the  pupils  are  required 
to  name  and  describe  them  but  not  to  translate  the  sentences. 

5.  Functional  Latin  Grammar  Test.    A  series  of  Latin  constructions  chosen  from 

the  Latin  Sentence  Test.    The  pupils  are  graded  on  their  ability  to  read 

correctly  these  constructions  in  their  normal  settings. 
Publisher:  Parker  Educational  Company,  Madison,  Wisconsin. 
Reference:  Brown,  H.  A.     A  study  of  ability  in  Latin.    Oshkosh,  WisconsiH:  H.  A. 

Brown,  1920. 

Hanus'  Latin  Tests.  These  consist  of  four  tests  for  vocabulary,  a  translation  test  and  a 
grammar  test.  All  of  these  tests  are  based  on  Caesar  and  Cicero.  No  words 
appear  in  the  vocabulary  tests  "which  occur  less  than  one  hundred  times  in  Caesar 
and  Cicero."  The  translation  test  "contains  only  constructions  which  are  found 
at  least  500  times  in  Caesar  and  Cicero." 

Address:  Paul  Hanus,  Harvard  University,  Cambridge,  Massachusetts. 
Reference:  Hanus,  P.  H.     "Measuring  progress  in  learning  Latin,"  School  Review, 
24:342-.34S,  May,  1916. 

Four  Latin  vocabuiary  tests  are  reproduced  with  suggested  credit,  direetiooa  far  gradiag  a&d 
making  correlations. 

Henmon's  Latin  Tests. 

1.  iMin  Vocabtdary  Tests  selected  from  239  words  common  to  thirteen  beginners' 

books  and  to  Caesar  and  Vergil. 

(1)  Texts  A,  B,  C,  and  D  are  of  equal  difficulty  and  each  consifts  of 
fifty  words  arranged  in  order  of  increasing  difficulty. 

(2)  Text  X  is  a  selection  of  5  words  having  approximately  the  same 
scale  values,  which  may,  therefore,  be  disregarded  in  scoring  and  each  word 
given  the  same  weight. 

2.  Latin  Sentence  Tests.    Graded  sentences  containing  no  word  not  included  in 

the  239  standard  words. 
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(1)  Tests  I  and  II  are  of  equal  difficulty  and  each  consists  of  ten  sen- 
tences arranged  in  order  of  increasing  difficulty. 

(2)  Test  III  is  a  selection  of  ten  sentences  of  approximately  the  same 
difficulty. 

Publisher:  V.  A.  C.  Henmon,  University  of  Wisconsin,  Madison,  Wisconsin. 

Also  obtainable  from  the  Bureau  of  Educational  Research,  University  of 

Illinois,  Urbana,  Illinois. 
Reference:  Henmon,  V.  A.  C.     "Measurement  of  ability  in  Latin,"  Journal  of 

Educational  Psychology,  8:515-38,  589-99,  November-December,  1917. 

This  article  gives  the  derivation  of  the  tests. 

Lohr's  Latin  Test.   This  is  a  "form  test"  to  be  given  at  the  end  of  the  first  year.    Pupilv 
are  asked  to  identify  the  forms  of  certain  nouns,  pronouns,  and  verbs. 
Address:  School  of  Education,  University  of  North  Carolina,  Chapel  Hill,  North 

Carolina. 
Reference:  Lohr,  L.  L.     "A  Latin  form  test  for  use  in  high  school  classes,"  High 
School  Journal,  1:7-9,  14-17,  November-December,  1918. 

Gives  critical  account  of  the  appropriateness  of  Starch's  Latin  tests  and  the  derivation  of  a 
form  test. 

Starch's  Latin  Vocabulary  Tests. 
Starch's  Latin  Reading  Test. 

See  Starch's  French  Tests  for  a  description  of  these  two  tests. 
Publisher:  These  scales  have  been  withdrawn  from  distribution. 
Reference:  Starch,  Daniel.     Educational  measurements.    New  York:  Macmillan, 
1916. 

See  Chapter  XI:  "Measurement  of  ability  in  Latin,"  for  reproduction  of  tests,  and  their  deri-  a 
tion. 

Starch-Watters'  Latin  Tests.     This  is  a  second  series  of  Latin  tests  prepared  by  Pro- 
fessor Starch,  in  collaboration  with  Mr.  Waiters.     It  consists  of  ( 1 )  Latin  vocabu- 
lary test  based  on  Lodge's  Vocabulary  of  High  School  Latin;  (2)  translation  tests 
for  each  of  the  four  years  of  the  high  school  course. 
Address:  University  Cooperative  Co.,  Madison,  Wisconsin. 

Wentworth  Latin  Tests.  Test  1  consists  of  one  hundred  English  words,  some  of  which 
come  from  the  Latin.  The  pupil  is  to  mark  each  word  showing  whether  it  comes 
from  the  Latin  or  not.  Test  2  consists  of  one  hundred  English  words  which  are 
derived  from  the  Latin.  The  pupil  is  to  give  the  Latin  root. 
Address:  Marj'  M.  Wentworth,  Hollywood  High  School,  Los  Angeles,  California. 
Reference:  Wentworth,  M.  M.     "An  experiment  with  two  Latin  tests,"  School 

Document  No.  26,  Los  Angeles  City  School  District,  Division  of  Educational 

Research,  October,  1919. 

D.  Spanish 
Wilkins'  Predetermination  Test  in  Spanish.     Mr.  Wilkins  states  that  language  ability 
is  predicted  largely  upon  (1)  susceptibility  to  impression;   (2)  readiness  and 
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accuracy  of  expression;  (3)  grasps  of  ordinary  grammatical  concepts.     There  are 
four  ways  for  testing  impression  and  expression: 

1.  Visual — motor  (see  and  writing) 

2.  Aural — motor  (hearing  and  writing) 

3.  Visual— oral  (seeing  and  speaking) 

4.  Aural — oral  (hearing  and  speaking). 
Then  there  is  a  test  of  grammatical  concepts. 

Reference:  Wilkins,  L.  A.     "Testing  for  ability  to  learn  a  foreign  language." 

Bulletin  of  High  Points  in  the  Work  of  the  High  Schools  of  New  York  City, 

V.  1,  no.  2,  p.  5,  February,  1919;  October,  1919,  no.  8,  p.  26. 

A  discussion  of  the  test  and  scoring  is  followed  by  the  reproduction  of  the  test.  Results  are 
given  in  the  October  Number. 

VI.  Handwriting 

Ayres'  Scale  for  Measuring  the  Quality  of  Handwriting  of  Adults.  This  scale  is  similar 
to  the  well-known  A3a'es'  Scale,  "three  slant  edition"  except  samples  of  the  hand- 
writing of  adults  were  used  in  its  construction. 

Publisher:  Russell  Sage  Foundation,  Division  of  Education,  New  York  City. 
References:  Ayres,  L.  P.     A  scale  for  measuring  the  quality  of  handwriting  of  adults. 

(Division  of  Education,  Russell  Sage  Foundation,  Bulletin  E  138.) 
Penmanship:  determining  the  achievement  of  elementary  school  graduates  in  hand- 
writing (Bulletin  No.  IX  of  the  Department  of  Educational  Investigation  and 
Measurement,  Boston  Public  Schools,  1916.) 

"On  November  23,  1914,  a  test  in  accurate  copying  was  given  to  4,494  pupils  in  the  first-year 
classes  of  fourteen  high  schools  in  Boston.  In  the  test  nothing  was  said  to  the  pupils  about  their 
penmanship,  hence  they  did  not  know  that  the  quality  of  their  handwriting  was  to  be  considered." 
The  Ayres'  Scale  for  Measuring  Handwriting  of  Adults  was  used  in  rating  these  samples.  Results 
are  given. 

Johnston,  J.  H.     "A  comparison  of  the  Ayres  ajid  Thorndike  handwriting  scales 

(containing  a  table  of  equivalent  values  in  the  two  scales),"  North  Carolina 

High  School  Bulletin,  7:170-73,  October,  1916. 
Ayres'  Handwriting  Scale,  "Gettysburg  Edition."    This  is  the  latest  edition  of  Ayres' 
handwriting  scales.     Numerous  changes  have  been  introduced  which  make  it  a 
more  accurate  instrument  than  the  "three  slant  edition."     It  uses  the  first  three 
sentences  of  the  "Gettysburg  Oration"  as  copy  material. 
Publisher:  Russell  Sage  Foundation,  Division  of  Education,  New  York  City. 

Also  obtainable  from  the  Bureau  of  Educational  Research,  University  of 

Illinois,  Urbana,  Illinois. 
References:  Breed,  F.  S.     "The  comparative  accuracy  of  the  Ayres'  Handwriting 

Scale,  Gettysburg  Edition,"  Elementary  School  Journal,  18:459-63,  February, 

1918. 

The  "Gettysburg  Edition"  is  shown  to  yield  toon  accurate  measures  than  the  "three  slant 
edition." 

Lewis,  E.  E.     "The  present  standard  of  handwriting  in  Iowa  Normal  Training 
High  Schools,"  Educational  Administration  and  Supernsion,  1 :663-7l,  Decem- 
ber, 1915. 
"This  report  describes  an  investigation  of  the  quality  and  speed  of  the  handwriting  of  1,760 

third  and  fourth-year  students  in  166  Iowa  Normal  Training  High  Schools." 
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Ayres'  Measuring  Scale  for  Handwriting.     "Three  Slant  Edition."    This  is  the  lirst 
of  the  handwriting  scales  devised  by  L.  P.  Ayres. 

Publisher:  Russell  Sage  Foundation,  Division  of  Education,  New  York  City. 
References:  Ayres,  L.  P.     A  scale  for  measuring  the  quality  of  the  hand-writing  of 

school  children.     (Division  of  Education,  Russell  Sage  Foundation,  Bulletin 

No.  113.) 

This  is  an  account  of  the  derivation  of  the  scale. 

Courtis,  S.  A.     The  Gary  public  schools:  measurement  of  classroom  products.     New 

York:  General  Education  Board,  1919,  p.  68. 
Cleveland  Free  Choice  Test.    This  refers  only  to  the  method  of  securing  samples  of  the 
handwriting  of  pupils. 
Reference:  Courtis,  S.  A.     The  Gary  public  schools:  measurefnent  of  classroom 

products.    New  York:  General  Education  Board,  1919,  p.  49. 

VII.  History 
A.  General 
Rugg's  Tests  for  Historical  Judgment. 

Address:  E.  U.  Rugg,  Oak  Park  High  School,  Oak  Park,  Illinois. 
Reference:  Rugg,  E.  U.     "Character  and  value  of  standardized  tests  in  history," 
School  Review,  27:757-71,  December,  1919. 

The  author  discusses  the  existing  tests  in  the  field,  general  features  and  general  criticisms  of 
existing  tests,  value  of  the  testing  movement  in  history.  He  inserts  a  table  which  gives  the  following 
information:  name  and  title,  where  reported,  type,  kind  of  questions  and  general  comment. 

B.  Ancient  History 
Barnard's  Test  in  Roman  History.    A  test  covering  one  period  of  ancient  history. 

Address:  A.  F.  Barnard,  University  High  School,  University  of  Chicago,  Chicago, 
Illinois. 
Sackett's  Scale  in  Ancient  History.    This  scale  is  composed  of  six  tests  based  on  care- 
fully selected  information  in  ancient  history. 

Publisher:  L.  W.  Sackett,  University  of  Texas,  Austin,  Texas.     Also  obtainable 
from  Bureau  of  Educational  Research,  University  of  Illinois,  Urbana,  Illinois. 
Reference:  Sackett,  L.  W.     "A  scale  in  ancient  history,"  Journal  of  Educational 
Psychology,  8:284-93,  May,  1917. 
TUs  article  gives  the  derivation  of  the  scale. 

C.  United  States  History 

Barr's  Diagnostic  Tests  in  United  States  History.     A  test  to  diagnose  historical  abili- 
ties. 
Address:  A.  S.  Barr,  19  S.  La  Salle  Street,  Chicago,  Illinois. 

Harlan's  Test  of  Information  in  American  History.  This  is  an  information  test  in 
American  history.  It  consists  of  ten  exercises  based  on  an  analytical  study  of 
textbooks  in  American  history.  This  test  gives  the  teacher  a  measure  of  the 
efficiency  with  which  the  information  side  of  American  history  has  been  taught. 
It  may  be  used  in  first  year  of  high  school. 
Publisher:  Bureau  of  Educational  Research,University  of  Illinois,Urbana,  Illinois. 
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Sackett's  Scale  in  United  States  History.  This  scale  is  composed  of  seven  different 
tests  based  on  carefully  selected  information  in  United  States  history.  This  scale 
can  be  used  with  pupils  who  have  studied  history  above  the  sixth  grade.  It  is 
difficult  enough  to  test  most  high-school  and  college  students.  It  is  based  upon 
the  work  of  Bell  and  McCoUum. 
Publisher:  L.  W.  Sackett,  University  of  Texas,  Austin,  Texas.    Also  obtainable 

from   Bureau   of   Educational   Research,   University  of  Illinois,   Urbana, 

Illinois. 
References:  Bell,  J.  C.  and  McCoUum,  D.  F.     "A  study  of  the  attainments  of 

pupils  in  United  States  history,"  Journal  of  Educational  Psychology,  8:257- 

74,  May,  1917. 
Sackett,  L.  W.     "A  scale  in  United  States  history,"  Journal  of  Educational 

Psychology,  10:345-49,  September,  1919. 

Starch's  American  History  Test,  Series  A.    This  test  consists  of  69  mutilated  sen- 
tences in  which  the  pupil  is  asked  to  write  the  missing  words  or  phrases. 
Publisher:  University  Cooperative  Co.,  Madison,  Wisconsin. 

VIII.  Mathematics 
A.  General 
Rogers'  Mathematics  Tests.    These  are  a  series  of  tests  designed  to  measure  several 
types  of  ability  in  the  field  of  mathematics.    The  series  include  tests  on  arithmetic 
and  algebra  as  well  as  geometry. 
Publisher:  Bureau   of   Publications,   Teachers    College,    Columbia   University, 

New  York  City. 
Reference:  Rogers,  A.  L.     Experimental  tests  of  mathematical  ability  and  their 
prognostic  value.      (Teachers  College  Contributions  to  Education,  No.  89.) 
New  York:  Teachers  College,  Columbia  University,  1918. 

Miss  Rogers  discusses  in  her  thesis  (1)  summary  of  previous  work;  (2)  general  conditions  of  the 
present  investigation,  application  of  the  tests  and  system  of  scoring;  (3)  analysis  of  mathematical 
ability;  (4)  prognosis  of  mathematical  ability. 

B.  Arithmetic 
Buckingham's  Scale  for  Problems  in  Arithmetic.  This  scale  consists  of  three  divisions 
called:  Division  1,  Division  2,  and  Division  3,  which  are  designed  for  different 
grades.  Each  division  consists  of  ten  problems  evaluated  in  terms  of  difficulty. 
Difficulty  is  understood  to  mean  the  difficulty  of  getting  the  correct  answer. 
Problems  in  Division  3  are  in  most  cases  sufficiently  difficult  for  use  in  the  high 
school. 

Ptiblisher:  Bureau  of  Educational  Research,  University  of  Illinois,  Urbana, 
Illinois. 

Cleveland  Survey  Arithmetic  Tests.  They  were  designed  for  use  in  the  survey  of  the 
Cleveland  public  schools.  The  series  consists  of  fifteen  tests,  including  four  in 
addition,  two  in  subtraction,  three  in  multiplication,  four  in  division,  and  two  in 
addition  and  subtraction  of  common  fractions. 

Publisher:  Bureau   of  Educational  Research,   University  of  Illinois,  Urbana, 
Illinois. 
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References:  Counts,  G.  S.  Arithmetic  tests  and  studies  in  the  psychology  of  arith- 
metic. (Supplementary  Educational  Monographs,  v.  1,  no.  2)  Chicago:  Uni- 
versity of  Chicago  Press,  1917. 

Courtis,  S.  A.  The  Gary  public  schools:  measurement  of  classroom  products.  New 
York:  General  Education  Board,  p.  147. 

Courtis  Standard  Research  Tests,  Series  B.  These  are  the  well-known  Courtis  arith- 
metic tests.  The  series  consists  of  four  tests,  one  on  each  of  the  operations  with 
integers. 

Publisher:  S.  A.  Courtis,  82  Eliot  St.,  Detroit,  Michigan.    Also  obtainable  from 

Bureau  of  Educational  Research,  University  of  Illinois,  Urbana,  Illinois. 

References:  School  report  of  the  town  of  Southington,  Connecticut,  1919,  p.  24. 

An  account  of  the  use  of  the  Courtis  Arithmetic  Tests,  Series  B,  in  first-year  high-school  com- 
mercial classes. 

Courtis,  S.  A.  The  Gary  public  schools:  measurement  of  classroom  products.  New 
York:  General  Education  Board,  1919,  p.  147  ff. 

In  addition  to  reporting  on  the  use  of  these  tests  in  the  high  school,  the  author  gives  an  account 
of  how  his  tests  were  constructed  and  a  discussion  of  their  validity  and  reliability. 

C.  Algebra 
Coleman's  Scale  for  Testing  Ability  in  Algebra.    This  test  consists  of  a  series  of  exer- 
cises arranged  in  order  of  difficulty. 
Publisher:  W.  H.  Coleman,  Bertrand,  Nebraska. 
Hotz's  First- Year  Algebra  Scales.    These  scales  consist  of  five  lists  of  algebra  exercises : 
(1),  addition  and  subtraction;  (2)  multiplication  and  division;  (3)  equation  and 
formula;  (4)  problems;  and  (5)  graphs.     In  each  list  the  exercises  are  arranged  in 
order  of  diflSculty.     These  scales  are  designed  to  determine  the  ability  of  pupils 
in  terms  of  the  exercises  which  just  50  percent  of  the  class  are  able  to  solve  cor- 
rectly.   They  are  instruments  for  measuring  the  abilities  of  classes  rather  than  of 
individuals.     No  measure  of  rate  of  work  is  secured. 

Publisher:  Bureau  of  Publications,  Teachers  College,  Coltimbia  University, 
New  York  City.  Also  obtainable  from  Bureau  of  Educational  Research, 
University  of  Illinois,  Urbana,  Illinois. 
References:  Hotz,  H.  G.  First-year  algebra  scales.  (Teachers  College  Contribu- 
tions to  Education,  No.  90.)  New  York:  Teachers  College,  Columbia 
University,  1918. 
Dr.  Hotz  in  his  thesis  discusses  the  origin  and  use  of  the  First- Year  Algebra  Scales. 

Cawl,  F.  R.  "Practical  uses  of  an  algebra  standard  scale,"  School  and  Society, 
10:88-90,  July  19,  1919. 

An  account  of  the  wajrs  in  which  the  Hotz  First-Year  Algebra  Scales  are  of  value  to  the  super- 
intendent and  teacher. 

Indiana  Algebra  Tests.  A  series  of  twelve  tests  which  incorporated  Monroe's 
Standard  Research  Tests  in  Algebra  and  six  tests  devised  by  H.  G.  Childs  of 
Indiana  University.     Not  available  for  use. 

Reference:  Childs,  H.  G.  "The  measurement  of  achievement  in  algebra,"  Third 
Conference  on  Educational  Measurements.  (Bulletin  of  the  Extension  Divi- 
sion, Indiana  University,  v.  2,  no.  6)  1917,  p.  171-83. 

Sample  exercises  from  tests  are  reproduced  and  results  tabulated.    Monroe's  and  Rugg's  tests 
are  compared. 
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Los  Angeles  Test  in  9A  Algebra.    This  test  was  devised  by  a  committee  of  Los  Angeles 

high-school  teachers.     It  is  based  on  the  work  of  Rugg  and  Clark. 

Reference:  Second  year  book  of  the  Division  of  Educational  Research,  Los  Angela, 

California,  July,  1919,  p.  113. 

The  test  is  reproduced  with  answers,  results  and  graphs. 
Monroe's  Standard  Research  Tests  in  Algebra.    These  tests  are  based  upon  the  simple 
equation  and  the  steps  involved  in  its  solution.    There  are  five  tests,  one  upon  each 
of  the  processes  involved  and  a  sixth  test  requiring  a  complete  solution  of  a  simple 
equation. 
Publisher:  Bureau  of  Educational  Measurements  and  Standards,  Kansas  Stat« 

Normal  School,  Emporia,  Kansas. 
References:  Monroe,  Walter  S.     "Test  of  attainment  of  first-year  high  school 

students  in  algebra,"  Sclwol  Review,  23:159-71,  March,  1915. 

This  contains  an  account  of  the  derivation  of  the  tests  and  their  use  with  high  school  pupils. 
Monroe,  Walter  S.     "Measurement  of  certain  algebraical  abilities,"  School  and 

Society,  1:393-5,  March  13,  1915. 
Second  and  third  annual  reports  of  the  Bureau  of  Educational  Measurements  and 

Standards,  1915-1917,  p.  76  ff. 

Results  for  twenty -five  cities  are  given. 
Rugg  and  Clark's  Standardized  Tests  in  First- Year  Algebra.    This  series  includes  six- 
teen tests  which  are  intended  to  measure  the  ability  to  do  all  of  the  t>pes  of  exer- 
cises in  the  work  of  the  first  year. 

Publisher:  University  of  Chicago  Press,  Chicago,  Illinois. 
References:  Rugg,  H.  G.     "The  experimental  determination  of  standards  in  the 

first-year  algebra,"  School  Review,  24:37-66,  January,  1916. 

The  author  states,  "A  report  of  the  mathematics  section  of  the  Illinois  High  School  Conference 
of  a  preliminary  investigation  for  the  purpose  of:  (1)  establishing  certain  methods  by  which  stand- 
ards for  measuring  the  outcomes  of  a  year's  instruction  in  high-school  algebra  may  be  constructed; 
(2)  stating  tentative  results  obtained  in  eight  Illinois  high  schools;  (3)  making  certain  criticisms  of 
the  learning  and  teaching  preceas  in  algebra." 

Rugg,  H.  O.  and  Clark,  J.  R.  "The  miprovement  in  ability  in  the  use  of  the 
formal  operations  of  algebra  by  means  of  formal  practice  exercises,"  School 
Review,  25:546-54,  October,  1917. 

Suggestions  and  directions  for  the  use  of  such  material  in  a  cooperative  experiment  in  the  teach- 
ing of  first-year  algebra,  carried  on  with  a  number  of  progressive  teachers  seeking  to  improve  the 
teaching  of  the  subject. 

Rugg,  H.  O.  and  Clark,  J.  R.  "Standardized  tests  and  the  improvement  of  teach- 
ing in  first-year  algebra,"  School  Review,  25:113-32,  196-213,  February- 
March,  1917. 

This  final  report  made  to  the  Illinois  High  School  Conference  inclutles  an  account  of  the 
derivation  of  their  tests.  A  reproduction  (including  "verbal  problems")  and  the  standardization  o* 
the  tests. 

Rugg,  H.  O.  and  Clark,  J.  R.  Scientific  method  in  the  reconstruction  of  ninth-grade 
mathematics.  (Supplementary  Educational  Monographs,  v.  2,  no.  1,  April, 
1918),  p.  52-86.     Chicago.:  University  of  Chicago  Press,  1918. 

"In  this  monograph  the  authors  discuss  the  design  and  the  constructieB  of  staodardised  tests 
in  secondary  mathematics  and  v/hat  the  standardized  tests  revealed." 
( To  be  continued  in  the  A  pril  Number) 


Nrm0  SttmB  nnh  (Eommuntrattnna 


A  few  principals  and  some  teachers  in  the  Little  Rock  public  schools 
have  in  previous  years  shown  interest  in  applying  scientific 
Department  of  methods  to  school  work.     This  year,  however,  marks  the 

Educational  beginning  of  organized  effort.     Superintendent  R.  C.  Hall 

Measurements,  has  been  keenly  interested  in  this  new  phase  of  education 
Little  Rock,  for  some  time,  but  the  great  need  of  a  measuring  depart- 

Arkansas  ment  was  not  fully  realized  until  September  12,  1919,  at 

which  time  the  writer  was  named  as  Supervisor  of  the 
Department  of  Educational  Measurements. 

The  first  and  most  difiicult  problems  arising  in  the  organization  of  the 
new  department  was  that  of  securing  an  adequate  number  of  assistants  to 
carry  on  the  work.  Although  the  efiforts  of  the  department  for  the  first 
year  were  to  be  confined  to  the  fourth,  fifth,  and  sixth  grades,  the  children 
in  these  grades  occupy  72  rooms  and  are  divided  into  92  groups.  It  was 
readily  seen  that  the  supervisor,  who  is  principal  of  one  of  the  grammar 
schools,  could  do  but  little  of  the  actual  testing  and  scoring  of  papers. 

Relief  came  through  the  organization  of  a  normal  class  at  the  Model 
School.  This  class  is  composed  of  twenty  high-school  graduates,  under  the 
efficient  supervision  of  Miss  Lulu  B.  Chase. 

The  giving  and  scoring  of  tests  is  conducted  in  the  following  manner: 
A  conference  is  first  held  between  the  supervisor  of  the  subject  in  which  the 
test  is  to  be  given,  the  director  of  tests  (Miss  Chase),  and  the  Supervisor  of 
the  Department  of  Educational  Measurements.  At  this  conference  the 
test  is  selected.  Miss  Chase  gives  the  normal  class  a  course  of  training  in 
methods  of  giving  the  test.  When  the  students  are  sufficiently  trained,  they 
give  the  test  in  the  various  schools.  The  principals  and  teachers  give  the 
right  of  way  to  these  examiners,  making  it  possible  usually  to  complete  the 
testing  in  one  day.  The  test  papers  are  carried  back  to  the  Model  School, 
where  they  are  scored  by  the  students  and  the  results  tabulated  under  the 
supervision  of  Miss  Chase. 

During  the  present  school  year  tests  have  been  given  in  reading  and 
language.  The  results  have  been  tabulated  and  returned  to  the  schools. 
The  principals  and  teachers  of  these  subjects  are  doing  very  good  work  in 
studying  these  results,  noting  failures,  seeking  causes,  and  devising  means  of 
eliminating  defects.  We  believe  that  a  very  great  benefit  is  also  being  de- 
rived from  this  work  by  the  members  of  the  normal  class.  These  students 
will  enter  the  schools  next  year  as  teachers.  They  will  be  familiar  with  the 
methods  of  giving,  scoring,  and  interpreting  the  results  of  standardized 
tests — a  familiarity  which  will  be  expected  of  all  teachers  in  the  near  future. 
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Now  that  work  in  educational  measurement  is  passing  rapidly  from  the 
universities  to  the  public  schools  throughout  the  country,  many  superin- 
tendents are  looking  about  for  some  plan  by  which  departments  of  measure- 
ments can  be  put  into  operation  in  their  school  systems.  We  beheve  it  a 
timely  suggestion  that  the  educational  journals  ask  for  and  publish  repoits 
of  this  type  from  many  places  where  successful  plans  are  in  operation.  The 
above  plan  may  not  exactly  fit  any  other  system,  but  it  is  submitted  in  the 
hope  that  helpful  suggestions  may  be  gleaned  from  it. 

G.  T.  HUCKABY 

Supervisor  of  Educational  Measurements 

The  Journal  of  Educational  Research  has  received  from  Superin- 
tendent H.  O.  Dietrich  of  Kane,  Pennsylvania,  a  report 
Use  of  Reading  entitled  "Findings,  Statistics,  and  Recommendations  of 
Tests  at  Reading  Status  of  the   Kane   Schools  as  Revealed    by 

^ne.  Pa.  the    Administration    of    Monroe's    Standardized    Silent 

Reading  Tests,  December,  1919." 

The  editor  of  this  department  wishes  to  take  this  opportunity  to  say 
that  he  is  glad  to  receive  such  reports  and  to  invite  other  school  men  to  b«* 
kind  enough  to  send  a  copy  of  such  reports  as  they  may  issue  in  either  printed 
or  manuscript  form. 

The  limitations  of  space  prevent  the  publication  in  full  of  the  report 
submitted  by  Superintendent  Dietrich.  Since  the  value  of  an  educational 
test  depends  upon  the  constructive  changes  which  are  made  upon  the  basis 
of  the  information  revealed  by  the  tests,  his  recommendations  are  of  especial 
interest  and  for  that  reason  they  are  reproduced  below. 

Recommendations 

"1.  That  variability  be  reduced.  It  is  too  large.  The  only  variability 
plausible  is  that  of  grade  seven  in  rate  and  grades  five,  seven,  and  eight  in 
comprehension.     Variability  between  grades  and  buildings  is  also  too  great. 

"2.  That  the  rate  of  silent  reading  be  increased  up  to  and  including 
grade  six. 

"3.  That  comprehension  be  stressed  in  all  grades. 

"4.  That  an  effort  be  made  to  reduce  overlapping  of  grades. 

"5.  That  mechanics  be  stressed  in  the  first  three  grades  so  that  the  rate 
of  silent  reading  will  be  increased. 

"6.  That  the  quick  perception  and  sense  content  method  be  used  in 
preference  to  the  phonetic  in  the  primary  reading. 

"7.  That  all  reading  in  intermediate  grades  shall  be  done  under  guidance 
of  specific  purposes. 

"8.  That  practice  in  enlarging  the  span  of  attention  should  be  given 
in  the  lower  grades. 

"9.  That  comprehension  can  be  increased  by  insuring  a  sound  mechani- 
cal foundation.  .    . 

"10.  That  the  teachers  prepare  reading  exercises  for  the  pupiis  which 
are  not  found  in  regular  readers. 
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"11.  That  the  teachers  conscientiously  study  the  charts,  graphs,  and 
statistics,  and  make  reports  so  that  they  may  better  be  able  to  study  each 
child's  case. 

"12.  That  the  individual  scores  of  each  child  be  kept  on  file  so  that  the 
needy  cases  may  receive  attention  immediately  upon  diagnosis  of  their 
trouble. 

"13.  That  the  individual  defects  or  impediments  be  noted  for  each  case 
studied. 

"14.  That  the  subject  of  reading  be  made  a  constructive  study  on  the 
part  of  all  teachers." 

In  common  with  other  cities,  Boston  has  faced  the  problem  of  increasing 
the  salaries  of  teachers  in  public  schools.     The  school  committee  has  recently 
published  the  results  of  an  investigation  by  Superintendent 
Salary  Frank  B.  Thompson  concerning  the  "Salaries  of  public 

lacreases  at  school  teachers  in  cities  of  over  two  hundred  thousand 

Boston  population  in  the  United  States  and  in  selected  cities 

and  towns  in  Massachusetts. "*     From  a  supplementary 
publication  we  quote  the  following: 

Principles  Underlying  Proposed 
Salary  Increases 
"The  proposed  new  salary  schedule  has  been  prepared  by  the  School 
Committee  on  the  basis  of  three  underlying  principles  which  are  fundamen- 
tal: 

1.  Largest  proposed  increase  in  salary  goes  to  the  lowest  paid 
teachers  in  the  service. 

2.  Some  increase  in  salary  is  proposed  for  everyone  in  the  employ 
of  the  School  Committee. 

3.  The  amount  of  proposed  increases  and  the  readjustments  con- 
form as  closely  as  possible  to  the  supply  of  teachers. 

"The  lowest  paid  teachers  in  the  Boston  service  are  the  kinder- 
gartners  and  the  elementary  assistants.  Accordingly,  they  have  been 
given  the  largest  increase,  both  in  actual  amount  and  in  percent  of  increase. 
No  other  rank  of  teacher  is  given  more. 

"Some  increase  in  salary  has  been  provided  for  everyone.  The  nurses, 
school  physicians,  the  attendance  ofl&cers,  and  the  directors  and  supervisors 
have  all  been  allowed  increases  in  salaries  in  the  new  schedule.  In  addition, 
the  evening  school  teachers  and  the  teachers  in  summer  review  schools  will 
hereafter  receive  more  money  for  their  services.  Substitutes,  emergency 
assistants,  employees  in  the  school  centers,  and  clerks  in  the  executive  offices 
have  not  been  left  out  of  consideration.  A  substantial  increase  is  also  pro- 
posed for  school  janitors.  In  short,  the  School  Committee  has  consistently 
followed  the  principle  of  something  for  everybody  in  the  new  schedule. 

"In  the  varying  amounts  of  proposed  increases  for  different  ranks  of 
teachers,  the  School  Committee  has  recognized  that  there  are  inequalities 

i  School  Document  No.  19,  1919,  Boston  Public  Schools,  November,  1919. 


246  JOURNAL  EDUCATIONAL  RESEARCH  Vol.  1,  No.  3 

in  the  present  schedule,  as  pointed  out  by  teachers,  and  has  tried  to  readjust 
some  of  them.  In  addition,  the  School  Committee  has  also  taken  into  ac- 
count the  salary  schedules,  both  present  and  proposed,  in  other  cities. 
Assuming  for  the  moment  that  living  conditions  in  several  cities  may  be 
identical,  teachers  are  not  likely  to  leave  Boston  to  teach  in  other  cities  if 
Boston  salaries  are  equal,  or  about  equal,  to  salaries  in  those  cities.  Since 
comparatively  few  teachers  who  resign  from  teaching  go  into  other  occupa- 
tions, the  probabihty  of  losing  teachers  to  other  cities  depends  on  the  salary 
there.  In  establishing  the  proposed  new  salaries  the  School  Committee  has 
fixed  them  high  enough  so  that  the  salaries  of  teachers  elsewhere  will  not  be 
attractive  to  Boston  teachers.  Whether  the  proposed  salaries  are  high 
enough  to  attract  into  the  profession  those  qualified  by  nature  and  training 
to  teach  is  a  question  which  the  Committee  has  not  undertaken  at  this  time 
to  determine  fully  and  conclusively.  It  is,  perhaps,  significant  that  colleges 
and  universities  generally,  which  for  the  last  few  years  have  suffered  from  a 
falling  off  in  attendance,  are  now,  in  some  cases,  almost  overwhelmed  by 
the  number  of  students,  some  of  whom  will  eventually  take  up  the  teaching 
profession,  and  will,  undoubtedly,  be  attracted  thereto  by  the  present  genera 
movement  to  increase  teachers'  salaries." 


(E.  J.  AsHBAUGH,  Secretary  and  Editor') 


Well,  what  do  you  think  of  it?  Do  you  appreciate  the  fact  that  the  new 
Journal  of  Educational  Research,  the  journal  you  now  hold  in  your 
hands,  is  our  journal,  your  journal?  Do  you  feel  a  personal  pride  in  it  and  a 
personal  responsibility  for  the  material  that  goes  into  it;  for  the  influence 
which  it  wields?  Do  you  know  that  the  first  issue  had  not  been  out  a  week 
when  it  brought  to  your  secr«tary  an  inquiry  concerning  membership  in  the 
National  Association  of  Directors  of  Educational  Research? 

These  are  questions  to  which  we  wish  every  member  of  the  Association 
would  make  answer  for  himself.  Say  it  aloud.  See  and  hear  how  it  sounds 
and  then  remember  that  you  have  covenanted  with  yourself  to  give  some- 
thing of  your  time  and  thought  to  this  publication.  We  are  pledged  to  the 
idea  of  organized  bureaus  of  research  in  city  school  systems,  state  depart- 
ments of  education,  and  colleges  and  universities.  We  believe  that  such 
organization  is  the  most  eflSicient  means  of  gathering  and  evaluating  the 
data  which  are  necessary  for  progress  in  public  education.  Each  bureau  is 
working  upon  problems  peculiar  to  itself,  but  many  of  the  data  gathered  are 
of  more  than  local  interest.  Let  each  member  feel  morally  obligated  to 
send  to  Dr.  Buckingham,  editor-in-chief,  or  to  your  secretary  within  the 
next  thirty  days,  a  report  on  some  work  he  has  done.  The  report  need  not 
be  long.  It  should  be  clearly  written,  presenting  a  definite  problem,  con- 
cisely stating  the  method  of  procedure  and  the  results.  It  should  be  closely 
allied  with  the  work  of  public  school  teachers,  administrators  and  super- 
visors. It  should  give  an  answer  to  some  question  of  importance  to  them 
or  show  a  way  of  attack  which  they  can  use.  We  are  sure  you  have  the 
material  for  such  a  report.  Will  you  take  the  time  to  put  it  into  shape  for 
publication  and  send  it  in?  By  so  doing  you  will  at  once  discharge  at  least 
a  part  of  your  responsibility,  will  guarantee  the  success  of  the  Journal,  and 
be  of  real  service  to  education  throughout  the  country. 

What  are  people  thinking  of  the  new  Journal  of  Educational  Re- 
search? We  believe  it  will  be  quite  in  order  to  quote  from  some  of  the 
letters  which  reached  our  desk  within  a  few  days  after  the  first  number  was 
issued. 

"I  wish  to  say  that  no  educational  paper  has  ever  appealed  to  me  as 
much  as  the  first  copy  of  the  Journal  of  Educational  Research," — An  Ohio 
superintendent  of  schools. 
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"The  Journal  of  Educational  Research  looks  like  the  best  bet  in  the 
country." — Michigan. 

"I  have  just  received  the  Journal  of  Educational  Research.  It  is  going 
to  give  us  just  what  we  need." — Iowa. 

These  and  other  communications  indicate  that  those  who  have  seen  it, 
like  it.  But  has  it  occurred  to  you  that  one  or  more  of  your  progressive, 
wide-awake  friends  may  not  have  seen  it  yet?  Could  you  do  them  a  greater 
service  than  to  call  it  to  their  attention?  I  want  every  friend  of  mine  in 
Iowa  to  get  acquainted  with  it.     What  about  you  in  your  state? 


Director  J.  C.  De  Voss  of  the  Kansas  State  Normal  School  has  sent  in 
the  following  news  notes.  If  you  are  interested  in  any  of  the  problems  upon 
which  he  is  working,  write  him  and  thus  coordinate  your  work  and  get 
greater  results. 

"We  have  given  the  Army  Intelligence  Test  Alpha  to  the  Freshmen  and 
Sophomores  of  the  Kansas  State  Normal  School  and  to  high  school  students 
of  several  junior  high  schools,  also  to  some  pupils  in  the  intermediate  grades. 
We  are  preparing  a  manual  to  be  used  with  the  Army  Alpha  tests  in  the  pub- 
lic schools.  We  are  also  preparing  age  and  grade  distributions  of  the  scores 
obtained.  We  are  standardizing  a  new  Latin  Derivative  test  and  are  making 
good  progress  in  preparing  a  scale  for  use  in  Wood-working  in  Manual 
Training. 

"One  very  interesting  feature  of  our  work  this  year  is  that  of  extension 
classes  among  teachers  in  five  cities.  I  believe  this  work  is  sure  to  grow  in 
volume  and  in  importance  in  Kansas." 


Dr.  Ashbaugh  and  Dr.  Greene  of  the  Bureau  of  Educational  Service, 
University  of  Iowa,  have  been  engaged  in  two  very  interesting  surveys  this 
winter.  The  one  was  concerned  with  the  course  of  study  in  the  junior  high 
school  grades  and  involved  the  comparison  of  the  relative  efl&ciency  of  teach- 
ing Latin  and  Algebra  in  the  eighth  and  ninth  grades.  The  other  was  the 
formulation  of  a  constructive  buUding  program  for  a  school  district  in  which 
the  financial  possibilities  were  only  about  one-third  of  the  immediate  needs. 
This  latter  study  involved  a  comparison  of  the  assessed  valuation  of  real 
estate  and  the  actual  value  as  shown  by  sale  price.  If  any  reader  wishes  some 
real  enlightenment  at  the  expenditure  of  a  couple  of  hours'  work,  it  is  sug- 
gested that  he  go  to  the  county  recorder's  office  and  list  the  sale  price  of  a 
number  of  pieces  of  property  and  then  compare  these  with  the  values  shown 
on  the  assessor's  books  in  the  auditor's  office. 
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CONSTRUCTING  A  LANGUAGE  AND  GRAMMAR  SCALE 

W.  W.  Charters 
Carnegie  Institute  of  Technology 

Introduction 

In  our  studies  of  the  efficiency  of  school  children  in  using  correct 
speech,  two  difficulties  were  recognized  at  almost  the  beginning 
of  the  investigation.  In  the  correction  of  language  forms  upon 
a  language  level  without  knowledge  of  grammatical  rules  and 
definitions,  it  was  found  that  few  teachers  had  definite  informa- 
tion about  the  errors  which  their  children  made.  They  recognized 
that  errors  occurred  and  that  in  a  general  way  some  were  more 
common  than  others;  but  any  detailed  knowledge  of  exactly  how 
such  errors  should  be  attacked  was  almost  entirely  lacking.  This 
lack  of  definite  information  prohibited  them  from  making  local 
attacks  upon  specific  errors;  and  this  is,  in  almost  all  cases,  with 
some  marked  exceptions,  true  not  only  of  the  individual  teacher 
but  also  of  whole  school  systems.  For,  the  tendency  is  to  take 
pot  shots  at  errors  and  this  in  spite  of  the  fact  that  the  only 
method  of  correction  is  to  attack  them  one  at  a  time  and  that  a 
certain  number  of  errors  should  be  assigned  to  each  grade  for 
frontal  attack  with  the  supporting  assistance  of  the  grades  above 
and  below. 

It  was  found  also,  that  the  study  of  grammar  seemed  to  have 
an  almost  negligible  effect  upon  the  correction  of  errors.  A 
steady  increase  of  skill  from  grade  to  grade  is  noticeable  before 
grammar  is  studied  but  in  the  grades  where  grammar  is  taught 
and  where  a  rapid  increase  in  skill  is  expected  there  did  not  seem 
to  be  a  greater  increase  than  in  the  lower  grades  in  which  instruc- 
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tion  is  not  given.  If  this  is  true,  then  two  results  must  follow. 
Either  grammar  should  be  eliminated  as  a  grade  subject  of  study 
or  methods  should  be  used  by  which  it  will  have  a  noticeable 
effect  upon  language  usage.  Very  serious  doubts  as  to  its  use- 
fulness in  grades  are  growing  rapidly.  But  until  it  is  clearly 
demonstrated  that  it  does  not  and  cannot  affect  the  correction  of 
errors,  the  doubt  will  not  be  resolved. 

The  probable  reason  for  its  failure  to  function  as  a  basis  of 
correction  is  that  the  educational  world  has  taken  the  indefensible 
position  that  incorrect  forms  must  not  be  placed  before  children. 
That  the  verb  must  agree  with  its  subject  in  person  and  number 
is  taught  in  connection  with  the  analysis  of  correct  sentences  only. 
For  in  select  educational  circles  it  is  considered  bad  form  to  place 
on  the  board  sentences  such  as,  "Was  you  looking  for  some- 
thing?" or  "He  don't  look  well"  and  ask  children  to  apply  the 
rule  to  their  correction.  This  is  probably  caused  by  a  confusion 
of  thought.  It  is  entirely  defensible  to  argue  that  -the  incorrect 
form  should  not  be  made  conspicuous  when  memory  alone  is 
involved.  Before  the  study  of  the  grammatical  rule  which  is 
found  broken  the  pupil  may  become  confused  by  seeing  both  the 
correct  and  incorrect  form  given  equal  prominence;  but  once  the 
rule  has  been  taught  and  memory  is  reinforced  by  reason,  there 
is  every  reason  for  fusing  the  error  and  the  rule  into  one  experience. 
Only  by  this  process,  carried  on  in  the  school  room,  will  the 
pupil  recognize  that  rules  have  any  use  as  correctives.  Until 
that  is  done  deliberately  and  thoroughly,  grammar  will  be  con- 
cerned merely  with  the  analysis  of  correct  sentences,  and  errors 
will  live  in  a  world  apart.  And  if  this  is  not  done,  grammar  must 
disappear  from  the  grades.  It  is  difficult  at  its  easiest,  and 
because  it  is  difl&cult,  it  leads  to  confusion  and  probably,  as  mental 
exercise,  does  more  harm  than  good.  If  it  can  demonstrate  its 
utility  as  a  corrective,  it  may  hope  to  live.  Like  other  vested 
interests  it  must  demonstrate  its  ability  to  render  service  to  the 
public. 

Following  the  realization  of  the  two  facts  that  language  errors 
are  not  attacked  methodically  and  persistently  and  that  grammar 
does  not  seem  to  function,  the  idea  was  developed  that  formal 
tests  might  be  devised  which  would  place  information  upon  both 
these  points  at  the  disposal  of  the  teacher.  Such  tests  should 
obviously  be  diagnostic  and  should  display  the  ability  of  the 
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pupils  to  recognize  incorrect  forms,  to  correct  them  and  to  give 
the  reason  for  correction  where  this  depended  upon  rules  of  gram- 
mar already  learned. 

Method 

By  language  tests  are  meant  those  in  which  the  pupil  is 
expected  merely  to  recognize  the  correct  form  and  by  grammar 
tests  are  meant  those  in  which  he  can  provide  in  addition,  the 
basic  rule  for  correction  couched  in  grammatical  terminology. 
To  say  that  "He  gave  it  to  me  and  Mary"  is  incorrect  because  it 
is  "impolite"  or  does  not  "sound  right"  is  not  a  use  of  grammar. 
The  grammatical  rule  states  that  the  first  personal  pronoun  stands 
last  in  a  series;  for  only  in  this  latter  case  is  the  .terminology  of 
grammar  used. 

In  constructing  the  language  tests  several  alternatives  pre- 
sented themselves.  The  first  form  considered  consisted  of  the  use 
of  alternative  forms,  the  incorrect  one  of  which  was  to  be  crossed 
out,  as  ^^Was)  {Were)  you  looking  for  something?"  This  form 
could  be  quickly  treated  by  the  pupils  and  rapidly  scored  by  the 
teacher.  But  it  would  not  give  an  accurate  display  of  the  normal 
ability  of  the  pupils  to  use  the  correct  form.  For  normally,  when 
an  individual  is  about  to  ask  the  question,  "(Was)  (Were)  you 
looking  for  something?"  he  does  not  have  the  two  forms  in  his  field 
of  attention;  if  they  were  both  there  the  hint  would  be  sufficient 
to  supplement  his  memory  in  the  choice  of  the  correct  one. 

This  form  was  discarded  and  the  device  accepted  of  stating, 
"In  the  following  sentences  some  are  correct  and  some  are  incor- 
rect. On  the  line  beneath  the  sentence  write  the  correct  form." 
It  was  felt  that  the  pupil  would  thereby  have  to  make  a  complete 
and  unassisted  decision  in  a  situation  approximating  very  closely 
to  the  conditions  of  normal  speech. 

In  the  grammar  test  the  same  sentences  are  used  but  in  addi- 
tion space  is  provided  on  the  right  half  of  the  test  page  for  giving 
the  reasons  for  any  corrections  made.  The  form  is  shown  in  the 
following  portion  of  one  of  the  tests.  The  complete  test  has  forty 
items.  The  title  and  the  provisions  for  general  information 
about  the  class  and  the  pupil  are  omitted. 

GENERAL  INSTRUCTIONS 

After  telling  the  children  not  to  turn  the  papers  over,  distribute  the 
folders,  this  side  up.  Have  each  pupil  fill  in  the  blanks  at  the  top.  Then 
say:  "Look  at  the  directions  while  I  read  them  to  you." 
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DIRECTIONS:  (To  be  read  by  the  teacher  and  pupils  together) 

"This  test  is  given  to  pupils  who  have  studied  language  and  grammar 
to  see  how  well  they  are  able  to  tell  when  sentences  are  right  and  when  they 
are  wrong.    Now  look  at  the  sample  below." 
1 .  I  told  him  to  go.  ( 


"The  plan  is  to  read  this  sentence  over  carefully  and  see  if  it  is  right. 
If  it  is  right  make  a  cross  on  the  dotted  line  below  the  sentence.  The  sen- 
tence, 'I  told  him  to  go,'  is  right  so  we  shall  make  a  cross  on  the  dotted  line 
below  it.  Make  the  cross  now."  (The  teacher  should  pause  to  allow  time 
for  doing  this  and  should  pass  around  the  room  in  the  lower  grades  to  make 
certain  every  pupil  understands.) 

"If  the  sentence  is  not  right  we  are  to  put  the  words  on  the  dotted  line 
below  it.    Let  us  try  one  that  is  not  right." 
2.  I  told  she  to  go.  ( 


"The  right  form  is  T  told  her  to  go.'  So  we  shall  write  'her'  on  the  line 
below  it." 

"On  the  right-hand  side  we  are  to  tell  why  we  make  the  change  on  the 
left-hand  side.  We  always  begin  our  reason  for  the  change  with  the  word 
Because.  In  this  case  we  write — Because  'her'  is  in  the  objective  case,  object 
of  the  verb,  told.  (The  teacher  should  pause  until  the  pupils  write  the  reason 
at  the  right  of  the  sentence.)  We  must  not  write  too  large  and  we  may  use 
all  of  the  lines  on  the  right-hand  side  so  that  we  may  have  plenty  of  room  for 
giving  our  reasons." 

"We  shall  now  try  a  third  exercise." 
3.  It  is  hisn.  ( 


"The  right  form  is  //  is  his.  We  make  the  change  Because  his  is  the 
possessive  form  of  the  pronoun,  he.  Fill  this  in  correctly,  writing  'his'  on  the 
line  below  and  beginning  the  reason  on  the  right-hand  side  with  the  word 
Because.    Do  this  now." 

"Remember  that  if  the  sentence  on  the  left  is  all  right,  we  do  not  need 
to  write  anything  on  the  right-hand  side  because  we  have  to  make  no  change 
and  so  have  to  give  no  reason  for  making  a  change." 

The  teacher  should  pass  around  the  room  and  see  that  the  children  fill 
these  in  correctly  and  when  all  have  finished  he  should  say,  "Begin  work  on 
the  exercises  below.  Stop  when  you  have  finished  this  page  and  bring  your 
paper  to  me."  This  is  not  a  speed  test  so  ample  time  should  be  allowed  to 
each  to  finish.  This  test  should  be  completed  in  two  periods  during  the  same 
day.    Part  I  should  occupy  the  first  period,  and  Part  II  the  second.    At  the 
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beginning  of  the  second  period,  go  over  the  above  instructions  so  far  as  may 
be  necessary  before  directing  the  children  to  begin  on  Part  II.  After  the 
children  have  finished  Part  II,  collect  the  papers. 


1.  John  went  to  town. 

1   

2.  May  Inez  and  me  go? 

2   

3.  It  teaches  a  person  something 
you  may  use. 

3   

4.  Yous  girls  play  too  hard. 

4  

5.  When  one  lives  in  town  they  hear 
noises. 

5  

6.  That  is  hern. 

6  

7.  Who  do  you  want? 

7   

8.  Him  and  I  will  do  it. 

8  

9.  Us  boys  did  it. 

9  

10.  The  boy  was  raised  by  its  own 
mother. 

10  

11.  These  books  are  yourn. 

11   

12.  It  was  a  book  with  riddles  in 
them. 

12  

13.  Are  those  them? 

13  

Content  of  the  Tests 
From  studies  made  in  Kansas  City,  Detroit,  and  elsewhere,  a 
rather  complete  list  of  common  grammatical  errors  in  the  verba- 
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tim  expressions  of  the  children  was  obtained.    These  were  used 
and  selection  was  made  upon  the  basis  of  frequency  of  occurrence. 
The  following  tests  were  constructed  in  duplicate  forms. 
I.  Language  IL  Language  and  Grammar 

Pronouns  Pronouns 

Verbs  A  Verbs  A 

Verbs  B  

Miscellaneous  Miscellaneous 

Each  test  has  forty  items,  one  or  two  of  which  are  correct,  to 
keep  faith  with  the  children  in  conforming  to  the  promise  that  they 
would  find  that  some  of  them  were  correct.  The  number,  forty, 
was  determined  partly  by  the  size  of  practicable  pages  and  partly 
by  the  fact  that  it  gives  a  comprehensive  list  of  the  errors  at  hand. 
The  forty  do  not  include  all  items  as  do  the  tests  of  the  funda- 
mental operations  in  arithmetic,  but  all  frequently  occurring  and 
many  infrequently  noticed  errors  are  included  so  that  for  purposes 
of  class  instruction,  where  only  the  commoner  ones  will  be  studied, 
as  distinguished  from  individual  errors  made  by  only  one  or  two, 
the  significant  ones  are  undoubtedly  included.  Some  pupils  will 
make  other  errors  but  all  of  sufficient  frequency  to  receive  class 
attention  are  present  in  the  tests. 

For  purposes  of  comparison  of  efiiciency  at  different  times  two 
forms  of  the  test  (Form  I  and  Form  II)  are  available.  The 
forms  are  alike  in  that  the  same  types  of  errors  are  included  in 
each  and  in  the  same  order  but  differ  in  the  sentences  in  which  the 
errors  are  found. 

The  language  tests  are  constructed  so  as  to  be  given  from 
grades  in  to  viii  or  in  the  high  school.  The  grammar  tests  will 
naturally  be  given  only  in  those  grades  which  studied  the 
grammatical  facts  involved. 

Time  Limit 
In  giving  the  tests  no  time  limit  is  prescribed  at  present.  This 
has  been  omitted  because  the  sentences  necessarily  vary  in  length 
if  approximately  natural  sentences  are  used;  and  relative  ability, 
as  shown  by  the  test,  would  be  greatly  affected  by  speed  in  hand- 
writing. In  the  grammar  division  of  the  test  time  conditions 
are  further  disturbed  by  the  fact  that  no  standardized  form  for 
stating  grammatical  rules  has  been  accepted  or  proposed  by  the 
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schools.  In  addition  to  these  considerations  opposing  the  setting 
of  a  time  limit  is  the  further  fact  that  the  test  being  diagnostic  in 
character  it  is  essential  that  all  the  errors  should  be  attacked  by- 
each  pupil. 

However,  in  our  most  recent  modification  of  the  language  sec- 
tion of  the  tests  we  are  experimenting  with  the  writing  of  correc- 
tions by  asking  the  pupils  not  to  write  the  whole  sentence  in  correct 
form  but  to  insert,  on  the  line  beneath,  the  correct  words}  This 
may  make  it  possible  to  set  a  time  limit  on  the  language  section ; 
but  it  does  not  remove  any  difficulty  in  the  grammar  section. 

Weighting 

A  very  careful  study  was  made  of  approximately  three  thou- 
sand one  hundred  seventh  and  eighth-grade  test  papers  on  pro- 
nouns to  determine  the  weight  of  each  item.  The  plan  followed 
was  to  determine  the  number  and  percent  of  incorrect  replies  and 
using  sigma  {a)  as  a  basis  and  2 .  So-  as  zero  to  give  the  approximate 
weight  to  each.  Fortunately,  it  was  found  that  the  relative 
ranking  of  individuals  was  not  appreciably  affected  by  dropping 
the  two  decimals  from  the  weighted  amount  and  using  the  nearest 
integer.  Furthermore,  it  was  discovered  that  the  correlation 
between  rankings  determined  upon  the  bases  of  unequal  and  equal 
weights  for  each  item  was  slightly  over  0.90.  Consequently,  it 
was  decided  to  adopt  the  simple  plan  of  counting  each  item  as 
possessing  unitary  value. 

It  is  entirely  possible  that  if  zero  ability  were  more  closely 
defined  than  2 .  So-  and  if  it  were  based  on  zero  third-grade  ability 
rather  than  upon  zero  seventh-grade  skill,  as  was  done  in  our  study 
of  the  three  thousand  one  hundred  cases,  the  weighting  might  be 
more  significant  than  has  been  found  in  the  latter  case.  But  for 
diagnostic  purposes,  which  is  the  professed  function  of  these  tests, 
this  consideration  is  not  of  great  significance. 

What  was  true  of  the  weighting  of  language  skill  when  based  on 
percentages  of  failure  was  more  noticeable  in  grammar  weightings 
because  of  the  very  large  percentages  of  failure  to  give  reason  for 
correction.  The  three  thousand  one  hundred  papers  examined 
had  a  median  percentage  incorrect  of  over  fifty. 

1  The  directions  reproduced  on  page  252  above  are  the  ones  used  in  this  modifica- 
tion of  the  original  test. 
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Scoring 

The  scoring  of  the  language  section  presents  no  serious  diffi- 
culty since  the  forms  tested  are  those  upon  which  any  well- 
informed  teacher  is  competent  to  judge.  However,  scoring  cards 
are  provided  to  expedite  the  work. 

In  the  grammar  section  the  absence  of  standardized  forms,  as 
in  addition  or  multiplication,  presents  a  rather  cumbersome 
difficulty.  For  instance,  the  sentence  "Him  and  I  will  do  it"  was 
written  correctly  as  "He  and  I  will  do  it."  The  reasons  given  for 
changing  to  the  correct  form.  He,  were  the  following  among 
many. 

[1)  Because"* jffc  is  in  the  nominative  case,  subject  of  the 
verb  will  do. 

[2)  Because  He  is  the  subject  of  the  sentence. 

[3)  Because  He  is  in  the  nominative  form. 

[4)  Because  He  is  subjunctive  form. 

[5)  Because  it  would  not  be  right  to  say  Him  will  do  it. 

[6)  Because  we  should  use  He  instead  of  him. 

[7)  Because  He  is  the  noun. 

[8)  Because  it  seems  to  be  turned  around. 

[9)  Because  me  is  objective  form,  object  of  the  verb  and. 

It  is  obvious  that  (7),  (8),  and  (9)  are  absurd  and  that  (5)  and 
(6)  give  no  grammatical  basis.  It  is  also  clear  that  (1)  is  a  com- 
plete answer  consisting  of  both  the  description  of  the  case  (nomina- 
tive) and  the  syntactical  relation  governing  it  (subject  of  the 
verb  "will  do").  The  difficulties  of  the  decision  of  all  such  cases 
is  seen  in  (2),  (3),  and  (4).  This  difficulty  arises  from  the  fact 
that  they  each  include  one  of  the  two  parts  of  the  complete  answer. 
The  second  (2)  gives  the  syntactical  relation;  (3)  gives  the  case 
form  and  (4)    is,  probably,  a  mixture  of  (2)  and  (3). 

It  was  decided  that  while  teachers  should  naturally  expect  a 
pupil  to  give  both  elements  as  a  standard  of  class  instructions,  an 
examiner  should  rate  the  answer  as  correct  if  one  or  the  other  of  the 
two  elements  were  given.  This  would  give  a  more  accurate  guage 
of  ability  than  would  the  elimination  of  (2),  (3),  and  (4).  For 
there  is  no  standard  form  for  the  answer  and  if  the  pupil  knows  the 
one  element  he  probably  knows  the  second  since  they  are  inter- 
dependent, and  in  any  case  either  one  of  the  two  elements  affords 
a  good  clue  for  practical  speech. 
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The  norms  to  be  established  for  these  scales  will  include  not 
only  the  median  but,  in  addition,  the  25  and  75  percentile.  This 
is  necessary  in  any  diagnostic  scale.  For  since  it  focuses  attention 
on  the  individual,  it  is  obvious  that  no  stimulation  will  be  derived 
from  its  use  by  the  half  of  the  class  above  the  median  if  only  the 
median  is  used  as  a  standard. 

The  Use  of  the  Tests 

These  tests  are  designed  to  serve  four  purposes.  In  the  first 
place,  a  teacher  who  gives  one  of  them  to  his  class  and  has  them 
marked  and  tabulated  has  a  clear  idea  of  the  points  at  which  to 
work  in  the  acquiring  of  language  skill,  an  idea  much  clearer  than 
that  afforded  by  incidental  and  more  or  less  casual  observation. 
In  the  second  place,  it  is  possible  by  the  use  of  the  alternative  forms 
to  see  what  progress  is  made  during  any  period.  In  the  third 
place,  they  provide  a  means  of  discovering  whether  or  not  gram- 
mar is  of  any  use  in  the  control  of  errors,  as  can  be  easily  found  by 
testing  freshman  students  in  high  school  who  have  and  have  not 
studied  grammar  in  the  grades.  Finally  it  presents  ocular  proof 
to  individual  pupils  that  they  do  not  know  how  to  use  certain 
forms  with  accuracy  and  ease. 

These  tests  are  still  in  tentative  form  and  the  cooperation  of 
those  interested  is  invited  for  assistance  in  smoothing  out  the 
defects  and  in  establishing  standards  for  the  grades  and  the  high 
school.  Copies  of  the  tests  and  other  information  may  be  obtained 
from  the  Bureau  of  Educational  Research  at  the  University  of 
Illinois,    Urbana,   Illinois. 


PSYCHOLOGICAL  TESTS  AS  A  MEANS  OF  MEASURING 

THE  PROBABLE  SCHOOL  SUCCESS  OF 

HIGH-SCHOOL  PUPILS 

W.  M.  Proctor 
Leland  Stanford  Junior  University 

The  validity  of  the  Stanford-Binet  Scale,  when  applied  to 
high-school  pupils,  has  already  been  discussed  by  the  writer  in 
the  issues  of  School  and  Society  appearing  October  19,  and  26, 
1918.^  In  those  articles  it  was  shown  that  very  significant  cor- 
relations had  been  obtained  between  intelligence  quotients,^ 
(L  Q.'s),  resulting  from  the  individual  tests  of  107  high-school 
pupils  and  the  school  marks  earned  by  the  same  pupils  during  the 
school  year,  1916-1917;  also  between  L  Q.'s  and  teachers' 
estimates  of  intelligence  made  during  the  same  year. 

Two  years  and  a  half  later  there  were  66  of  the  original  107 
high-school  pupils  remaining.  Teachers  who  had  known  all  of 
these  pupils  during  their  stay  in  the  high  school  were  asked  to 
give  estimates  of  their  intelligence  upon  the  same  rating  sheet  as 
that  which  was  used  in  1916-1917.  All  school  marks  earned 
during  the  two  and  one-half  years  were  averaged.  Correlations 
were  then  found  (a)  between  thel.  Q.'s  obtained  in  1916-1917  and 
the  teachers'  estimates  made  in  1919;  (b)  between  the  average 
of  all  school  marks  earned  up  to  April  1,  1919  and  I.  Q.'s  obtained 
in  1916-1917;  and  (c)  between  the  average  school  marks  and 
the  teachers'  estimates  made  in  1919.  Table  I  shows  the  close 
agreement  between  the  correlations  obtained  in  1916-1917  and 
those  found  in  1919. 

Table  I  shows  that  the  correlations  obtained  in  1918-1919, 
when  the  same  comparisons  were  made  as  in  1916-1917,  were 

*  Proctor,  W.  M.  "The  use  of  intelligence  tests  in  the  educational  guidance  of 
high-school  pupils,"  School  and  Society,  8:473-78,  502-9,  October,  19-26,  1918. 

^  The  intelligence  quotient  is  obtained  by  dividing  the  mental  age  by  the  chrono- 
logical age.  Thus  a  twelve-year-old,  chronologically  who  tested  eight  years  old 
mentally  would  have  an  I.  Q.  of  0.66,  expressed  for  convenience  "66."  The  I.  Q. 
is  an  index  of  relative  brightness.  For  further  discussion  of  intelligence  quotient  see: 
Terman,  L,  M.  The  intelligence  of  school  children,  Houghton  Miflflin  and  Co.,  1919, 
p.  7. 
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TABLE  I.      COMPARISON  OF  CORRELATION  OBTAINED 
IN  1916-1917  AND  THOSE  OBTAINED  IN  1918-1919* 


Year 

Correlation 

between  I.  Q. 

and  Teacher 

Estimates 

Correlation 

between  I.  Q. 

and  School 

Marks 

Correlation 

between  School 

Marks  and 

Teacher 

Estimates 

Total 

Number 

of 

Cases 

/ 

2 

3 

4 

5 

1916-17 

1918-19 

0.586±0.043 
0.583+0.055 

0.545+0.046 
0.487+0.063 

0.702+0.033 
0.667+0.046 

107 
66 

»  Pearson's  formula^  (shorter  method)  was  used  in  making  all  correlations. 

practically  as  high  as  those  obtained  in  the  first  instance.  The 
results  of  two  and  one-half  years  of  follow-up  work  seem  to  indi- 
cate that  the  person  who  made  the  original  tests  with  the  Stanford- 
Binet  Scale  in  1916-1917,  would  have  been  in  a  position  to  give 
very  helpful  advice  to  all  of  the  pupils  tested  by  him;  also  that 
his  predictions  as  to  the  possible  educational  future  of  each  of 
these  pupils  would  have  deserved  serious  consideration  by  parents 
and  teachers. 

As  a  means  of  discovering  individual  differences  between  school 
children  in  order  that  they  may  be  grouped  in  classes  according 
to  ability,  the  individual  psychological  test  has  been  shown  to  be 
a  helpful  tool.  From  the  standpoint  of  school  administration, 
however,  the  individual  test  presents  serious  difficulties.  The 
time  required  to  give  an  individual  test  to  a  high-school  pupil 
varies  from  40  minutes  to  120  minutes.  The  total  number  of 
pupils  that  can  be  examined  by  a  single  examiner  in  a  day  will 
seldom  exceed  ten.  The  use  of  the  Stanford-Binet  abbreviated 
scale  enables  an  examiner  to  test  from  15  to  25  pupils  in  a  day. 
Even  so,  it  is  impossible  to  use  the  individual  method  when  a 
rapid  survey  of  an  entire  school  population  is  to  be  undertaken. 

Group  mental  examinations  afford  the  only  means  of  meeting 
the  demand  for  a  speedy  and  reliable  method  of  measuring  the 
mental  abilities  of  large  groups  of  people.     Under  the  supervision 

^  Rugg,  H.  O.  Statistical  methods  applied  to  education.  New  York:  Houghton 
Mifflin  and  Co.,  1917,  p.  274. 
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of  Dr.  L.  M.  Terman  the  writer  directed  the  giving  of  Examina- 
tion a  (Form  A)  and  Examination  Alpha  (Form  5)  of  the  Army 
Scale  to  1,349  high-school  pupils,  representing  eight  California 
high  schools,  during  the  school  year  1917-1918. 

Examination  a  consists  of  ten  tests:  (1)  Oral  Directions, 
(2)  Memory  for  Digits,  (3)  Disarranged  Sentences,  (4)  Arith- 
metical Reasoning,  (5)  Information,  (6)  Synonym-Antonym, 
(7)  Common  Sense,  (8)  Number  Series  Completion,  (9)  Analogies, 
(10)  Number  Comparison.  The  total  possible  raw  score  is  237. 
This  test  was  given  to  portions  of  the  first-year  high-school  classes 
in  the  Oakland  Technical,  Oakland  Central  and  Fremont,  Oak- 
land, high  schools  and  to  all  of  the  pupils  present  on  the  day  of  the 
examination  at  the  Palo  Alto  Union  High  School.  The  total 
number  of  pupils  was  715. 

Group  Examination  Alpha  consists  of  eight  tests:  (1)  Oral 
Directions,  (2)  Arithmetical  Reasoning,  (3)  Practical  Judgment, 
(4)  Synonym-Antonym,  (5)  Disarranged  Sentences,  (6)  Number 
Series  Completion,  (7)  Analogies,  (8)  Information.  This  test 
was  given  to  all  pupils  present  on  the  day  of  examination  in  the 
San  Mateo,  Redwood  City,  Mountain  View,  and  Santa  Clara 
union  high  schools.     The  total  number  of  these  pupils  was  624. 

These  group  mental  examinations  were  applied  to  all  of  the 
pupils  in  each  of  the  high  schools  enumerated  above  at  exactly 
the  same  time.  A  sufficient  number  of  examiners,  trained  by 
Dr.  Terman,  were  taken  to  each  high  school,  to  cover  the  entire 
high  school  in  one  forty-five  minute  period.  The  size  of  the 
groups  ranged  from  40  to  1 50.  It  took  the  writer  and  his  assistant 
a  total  of  134  hours  to  test  107  high-school  pupils  by  the  individual 
method.  Six  trained  examiners  were  able  to  give  Examination  a 
to  350  Palo  Alto  high-school  pupils  in  45  minutes.  The  test 
blanks  were  scored  by  university  students.  Their  work  was 
carefully  checked  and  the  results  tabulated  by  the  writer. 

I.  Group  Test  Results  Compared  with 
Individual  Test  Results 
One  hundred  and  sixteen  of  the  high-school  pupils  tested  with 
Examination  a  had  previously  been  given  the  Stanford-Binet 
Scale.  Table  II  makes  comparison  of  the  two  kinds  of  mental 
examination.  Although  no  Binet  I.  Q.'s  are  found  in  the  group 
140-149,  six  Army  Scale  I.  Q.'s  are  between  140  and  149.     This 
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is  because  a  higher  mental  age  is  attainable  on  the  Army  Scale 
than  on  the  Binet  Scale.  For  example,  a  high-school  boy  fifteen 
years  and  two  months  old  passed  every  test  in  the  Stanford-Binet 

TABLE  II.       RELATION  BETWEEN  THE  I.   Q.'s   OF   116  HIGH-SCHOOL 
PUPILS  EARNED  ON  THE  STANFORD-BINET  SCALE  AND  THE 
I.  Q.'s  OF  THE  SAME  PUPILS  EARNED  ON  EXAMINA- 
TION a,  ARMY  SCALE 


I.  Q.'s  on  Examination  a 

,  Army  Scale 

I.  Q.'s  on 

Stanford-Binet 

Scale 

80- 
89 

90- 
99 

-100- 
109 

110- 
119 

{Median) 

120- 
129 

130- 
139 

140- 
149 

Totals 

/ 

2 

3 

4 

5 

6 

7 

8 

9 

130-139 

3 

7 

3 
9 

5 

1 

11 

120-129 

1 

3 

21 

110-119   {Median) 

2 

8 

11 

9 

2 

32 

100-109 

13 
11 

3 
8 

4 

20 

90-99 

7 
5 

26 

80-89 

5 

70-79 

1 

1 

Totals 

1 

14 

33 

25 

23 

14 

6 

116 

Median  for  Binet  I.  Q.:  group,  110-119 
Median  for  Army  Scale  I.  Q.:  group,  110-119 
Correlation,  Pearson's  formula,  0.736;  P.  E.,  0.029 

Scale,  thus  earning  a  mental  age  of  nineteen  years  and  six  months, 
and  an  I.  Q.  of  129.  On  the  Army  Scale,  Examination  a,  he  made 
a  raw  score  of  219,  corresponding  to  a  mental  age  score  of  twenty- 
one  years  and  eleven  months,  and  an  I.  Q.  of  144.^  In  other 
words,  the  Stanford-Binet  Scale  does  not  give  the  superior  high- 
school  pupil  an  opportunity  to  earn  as  high  an  I.  Q.  as  he  can 
earn  on  the  Army  Scale.     This  factor  would  tend  to  lower  the 

*  Mental  age  norms  for  both  tests  of  the  Army  Scale  were  worked  out  by  Dr. 
Samuel  Kohs  and  the  writer.  It  was  found  that  about  fifteen  points  on  Examination  a 
and  twelve  points  of  raw  score  on  Examination  Alpha  corresponded  roughly  to  a 
mental  age  year.  Possible  raw  score,  Examination  a,  237,  possible  mental  age  twenty- 
three  years;  possible  raw  score,  Alpha  212,  possible  mental  age  twenty-four  years 
and  nine  months. 
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correlation  between  the  two  sets  of  I.  Q.'s.  The  correlation 
obtained  in  Table  II  (+0.736)  is  a  strong  indication  that  if  the 
Stanford-Binet  Scale  is  a  valid  means  of  finding  the  mental  level 
of  high-school  pupils,  the  Army  Scale  Examination  a  is  also 
valid  for  the  same  purpose. 

II.    Army  Scale  Results  Compared  with 
High-School  Marks 

The  school  work  of  all  the  high-school  pupils  examined  by 
means  of  the  two  army  group  tests  was  carefully  followed  up  for 
the  school  years  1917-1918  and  1918-1919.  The  marks  given 
were  reduced  to  a  comparable  basis  by  assigning  arbitrary  values 
to  each  type  of  mark  employed  by  the  various  high  schools.  Thus 
an  "A"  or  a"!"  was  given  a  value  of  95;  a  "B"  or  a  "2,"  a  value 
of  85,  etc.  Letters  or  numbers  with  plus  and  minus  signs  were 
given  intermediate  values.  All  of  the  marks  earned  by  a  given 
pupil  were  averaged,  but  no  case  was  included  in  the  tables 
unless  the  marks  for  at  least  two  semesters  of  school  work,  the 
equivalent  of  one  year,  were  available. 

1.  Army  Scale,  Group  Examination  a. — Table  III  makes  a 
comparison  between  the  I.  Q.'s  obtained  from  the  Group  Examina- 
tion a  and  the  quality  of  high-school  work  of  494  high-school 
pupils.  The  total  number  taking  the  test  was  715,  but  only  494 
cases  had  ratings  for  one  year  of  school  work. 

Since  the  correlation  obtained  (+0.343)  is  12.8  times  the 
indicated  P.  E.,  it  has  considerable  significance.  While  it  is 
not  as  high  as  the  correlation  between  Binet  I.  Q.'s  and  school 
marks  found  in  Table  I,  there  are  several  factors  which  may  have 
tended  to  lower  the  correlation.  The  army  tests  were  designed 
for  use  with  soldiers  in  cantonments.  Many  of  the  questions 
have  to  do  with  matters  of  common  knowledge  about  a  military 
camp,  but  with  which  high-school  pupils  have  no  acquaintance. 
This  would  especially  affect  the  scores  of  high-school  girls.  There 
are  twenty  cases  falling  in  I.  Q.  groups  below  95,  where  the 
indicated  school  work  is  of  a  quality  of  80  percent  or  above,  and 
fifteen  of  these  cases,  or  75  percent,  are  girls. 

Another  factor  which  may  have  tended  to  lower  the  correla- 
tion is  the  skewness  of  the  school  marks  curve  toward  the  high 
percents.     The  median  school  marks  group  in  Table  III  is  80-84. 
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TABLE  in.      CORRELATION  BETWEEN  THE  I.   Q.'s   OF  ARMY   GROUP 

EXAMINATION  a  AND  THE  QUALITY  OF  SCHOOL  WORK 

OF  494  HIGH-SCHOOL  PUPILS 


Army  Group  Examination  a  I.  Q.'s 

School 
Marks 

84  or 
Lower 

85- 
89 

90- 
94 

95- 
99 

100- 
104 

105- 
109 

{Median) 

110- 
114 

115- 
119 

120- 
124 

125  or 
Above 

Totals 

1 

2 

3 

4 

5 

6 

7 

* 

9 

10 

11 

12 

90  or  above 

3 

5 

2 
9 

2 
18 

3 

24 

6 
22 

6 

24 

6 

8 

6 

4 

34 

85-89 

114 

80-84  {Me- 
dian) .... 

1 

2 

9 

28 

41 

46 

30 

13 

9 

3 

182 

75-79 

70-74 

65-69   .  . 

1 
2 

3 
3 
1 

9 
4 
1 

19 
14 

4 

19 

11 

1 

19 
11 

1 
1 

19 

7 
2 

7 
1 

1 

2 
1 

98 
54 
11 

55-64     .  . 

Totals 

4 

9 

31 

76 

92 

105 

86 

52 

26 

13 

494 

Medians:  I.  Q.'s  group,  105-109;  school  marks,  group  80-84 
Semi-interquartile  ranges:  I.  Q.'s,  6  points;  school  marks,  4>^  percent 
Correlation,  Pearson's  formula,  0.343;  P.  E.,  0.027 

This  represents  a  grade  of  "B"  or  "2."  It  is  necessary  for  these 
high-school  pupils  to  receive  marks  of  "B"  or  "2"  in  all  subjects 
required  for  university  recommendation.  The  Palo  Alto  high 
school  is  in  close  proximity  to  Stanford  University,  and  the 
Oakland  high  schools  are  in  the  immediate  vicinity  of  the  Univer- 
sity of  California.  The  fact  that  68.8  percent  of  the  grades 
given  to  these  494  high-school  pupils  were  "B"  or  above  is  an 
indication  that  teachers  were  influenced  in  their  marking  by  the 
demand  for  "B"  grades  for  university  recommendation.  Many 
pupils  with  just  average  ability  were  given  marks  ranking  superior. 
Hence  there  would  be  a  rather  wide  difference  between  their 
mental  ability  as  shown  by  the  tests  and  their  school  progress  as 
shown  by  their  marks. 

2.  Army  Scale,  Group  Examination  Alpha. — Table  IV  com- 
pares the  I.  Q.'s  of  480  of  the  high-school  pupils  of  San  Mateo, 
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Redwood  City,  Mountain  View,  and  Santa  Clara  with  their  school 
marks.  There  were  624  pupils  belonging  to  these  high  schools 
who  took  Examination  Alpha,  but  only  480  cases  came  under 
the  rule  requiring  ratings  for  one  whole  year  of  school  work. 

TABLE    IV.      CORRELATION    BETWEEN    THE    I.    Q.'S    OF    THE    ARMY 

GROUP  EXAMINATION  ALPHA  AND  THE  QUALITY  OF 

SCHOOL  WORK  OF  480  HIGH-SCHOOL  PUPILS 


Army  Group  Examination  Alpha 

LQ's 

School 
Marks 

84  or 
Lower 

85- 
89 

90- 
94 

95- 
99 

100- 
104 

105- 
109 

(Median) 

110- 
114 

115- 
119 

120- 
124 

125  or 
Above 

Totals 

/ 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

90  or  over. 

3 
8 
6 

3 
17 
22 

15 

15 
21 

12 

24 
20 

9 

13 
10 

9 
6 

5 

5 
6 
1 

56 

85-89 

89 

80-84 

4 

89 

75-79  (Me- 
dian) .... 

7 

25 

33 

23 

10 

7 

4 

109 

70-74 

4 
3 

10 
3 
2 

18 
12 

5 

14 
7 
3 

22 
8 
1 

12 

8 

1 

1 

1 

1 

82 

65-69 

1 

43 

55-64 

12 

Totals 

1 

7 

26 

77 

99 

105 

87 

41 

25 

12 

480 

Medians:  I.  Q.'s  group  105-109;  school  marks,  groups  75-79 
Semi-interquartile  ranges:  I.  Q.'s,  6  points;  school  marks,  t}4  percent 
Correlation,  Pearson's  formula,  0.413;  P.  E.,  0.026 

The  correlation  obtained  in  Table  IV  (+0.413)  is  15.9  times 
the  indicated  P.  E.  and  0.07  higher  than  the  correlation  found 
in  Table  III.  The  higher  correlation  found  in  this  table  may  be 
due  to  the  fact  that  Examination  Alpha  was  the  result  of  careful 
revision  of  the  first  series  of  tests  in  the  light  of  preHminary 
experimentation  in  three  army  cantonments  and  the  returns 
from  the  tests  of  several  thousand  school  children.  Also,  the 
high  schools  in  which  Examination  Alpha  was  appHed  were  not 
in  such  close  proximity  to  universities  as  were  the  high  schools 
represented  in  Table  III.  The  group  median  for  school  marks 
is  75-79,  and  only  48.8  percent  of  the  ratings  given  in  these  four 
high  schools  ranged  as  high  as  "B"  or  over. 
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When  account  is  taken  of  the  possible  reasons  for  the  difference 
in  the  correlations  as  shown  in  Tables  III  and  IV,  it  is  safe  to 
say  that  they  are  of  approximately  equal  value.  For  use  in  the 
public  schools  Examination  Alpha  is  the  better  scale,  because  it 
consists  of  but  eight  tests,  can  be  given  in  less  time,  is  scored 
more  rapidly,  and  costs  less  to  print. 

III.    Individual  and  Group  Mental   Tests  as   Means   of 

Indicating  Probable  Retention  or  Elimination  of 

High-School  Pupils 

1.  Elimination  among  pupils  tested  with  the  Stanford-Binet 
Scale. — On  the  first  day  of  April,  1919,  it  was  found  that  41  of  the 
original  107  pupils  tested  in  1916-1917  with  the  Stanford-Binet 
Scale  had  dropped  out  of  school,  leaving  66  still  in  attendance. 
Table  V  gives  the  distribution  of  the  107  cases,  showing  the 
I.  Q.'s  of  pupils  who  left  high  school  to  go  to  work,  of  pupils  who 
were  transferred  to  other  high  schools,  and  of  pupils  who  still 
remain  in  the  same  high  school. 

table  v.     distribution  on  APRIL  1, 191 9,  OF  107 
HIGH-SCHOOL  PUPILS  TESTED  WITH  STANFORD- 
BINET  SCALE  IN  1916-1917 


Binet  I.  Q.'s 
Earned  in 
1916-1917 

Total  Number 

of 

Cases 

Distribution  April  1, 1919, 1: 

)y  Percents 

Out  at 

Work  (%) 

Out,Transfer*d 

to  Other  High 

Schools  (%) 

Remaining  in 
Same  High 
School  (%) 

; 

2 

3 

4 

5 

79  or  lower 

80-89 

1 

7 
29 
27 
22 
15 

6 

100 

72 

31 

22 

0 

0 

0 

0 
14 

9 
22 
27 
13 
33 

0 
14 

90-99 

60 

100-109 

56 

110-119 

73 

120-129 

87 

130  or  above 

67 

No.  of  cases 

107 

21 

20 

66 

Median  L  Q.'s 

94 

110 

110 
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The  only  pupil  testing  below  80  I.  Q.  dropped  out  at  the  end 
of  the  first  semester  of  1916-1917  to  go  to  work.  All  of  those  in 
group  80-89  who  left  school  to  go  to  work,  did  so  by  the  end  of  the 
first  year.  Failure  in  school  work  has  been  recognized  as  the 
most  fruitful  cause  of  elimination  from  high  school,  but  the 
relation  between  mental  ability  and  failure  in  school  work  has 
not  heretofore  been  given  due  consideration.  At  the  end  of  two 
and  one-half  years  none  of  those  testing  below  80,  and  only  28 
percent  of  those  testing  80-89  remain  in  high  school.  On  the 
other  hand,  100  percent  of  those  testing  110  or  over  are  pursuing 
their  studies  either  in  the  Palo  Alto  high  school  or  in  other  high 
schools.  When  the  average  school  ratings  of  the  different  groups 
is  taken  into  account  the  close  connection  between  mentality 
and  elimination  will  be  still  more  apparent.  The  average  school 
rating  of  the  21  who  left  school  to  go  to  work  was  73  percent;  of 
the  20  transferred  to  other  high  schools,  77  percent;  and  of  the 
66  remaining  in  the  Palo  Alto  high  school,  79  percent. 

2.  Elimination  among  pupils  tested  with  the  Army  Examination 
a  and  Alpha. — ^Only  five  of  the  eight  high  schools  where  the  Army 
Scale  was  applied  were  selected  for  follow-up  work  in  connection 
with  elimination  because  the  records  of  the  three  Oakland  high 
schools  did  not  indicate  whether  the  pupil  leaving  had  been 
transferred  to  another  high  school  or  had  gone  to  work.  In  the 
case  of  the  Palo  Alto,  San  Mateo,  Redwood  City,  Mountain  View, 
and  Santa  Clara  high  schools,  it  was  comparatively  easy  to  secure 
reliable  data  with  reference  to  every  pupil  who  took  the  test. 
The  principals  of  all  these  schools  had  served  in  their  respective 
positions  from  four  to  fourteen  years,  knew  their  pupils  thorough- 
ly, and  had  on  record  information  concerning  the  movements 
of  those  who  had  left  school  since  the  giving  of  the  army  tests 
in  1917-1918. 

Table  VI  gives  for  those  tested  with  the  Army  Scale  a  distri- 
bution similar  .to  that  contained  in  Table  V  for  the  107  tested 
with  the  Stanford-Binet  Scale.  The  955  pupils  of  the  five  high 
schools  above  mentioned  have  been  distributed  by  I.  Q.'s  into 
four  groups:  (1)  those  who  left  high  school  to  go  to  work,  (2) 
those  who  transferred  to  some  other  high  school,  (3)  those  who 
graduated,  (4)  those  remaining  in  high  school  on  April  1,  1919. 
The  follow-up  work  covered  one  and  one-half  years  of  school 
work.    Figure  1  illustrates  graphically  the  data  of  Table  VI. 
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TABLE  VI.     DISTRIBUTION  OF  955  HIGH-SCHOOL  PUPILS  ON 

APRIL  1,  1919,  WHO  WERE  TESTED  WITH  ARMY 

SCALE  TESTS  IN  1917-1918  BY  I.  Q.  GROUPS 


Total 

Number  of 

Cases 

Distribution  on  April  1,  1919,  by  Percents 

Army  Scale 

I.  Q.'s  Earned 

1917-1918 

Out  at 
Work 

(%) 

Out,  Trans- 
ferred to  Other 
High  School 

(%) 

'Out  by 
Graduation 

(%) 

Remaining  in 
Same  High 
School  (%) 

/ 

2 

3 

4 

5 

6 

79  or  lower 

80-89 

90-99 

13 
73 
202 
283 
221 
101 
62 

61.5 

34.3 

26.2 

12.3 

4.0 

6.9 

1.6 

7.7 
8.2 
8.9 
8.8 
14.5 
11.8 
9.8 

0.0 
5.5 
11.4 
14.1 
23.0 
19.8 
24.6 

30.8 
52.0 

53  5 

100-109 

110-119 

120-129 

130  or  over 

64.8 
58.5 
61.4 
64.0 

No.  of  Cases .  . 

955 

138 

100 

153 

546 

Median  I.  Q.'s . 

96 

110 

111 

107 

Percent  I.  Q.'s 
below  100.  . . 

62.4 

25.0 

17.6 

26  5 

FIGURE  1 .      ILLUSTRATING  TABLE  VI 
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In  this  table  there  appears  to  be  a  strong  confirmation  of  the 
findings  of  Table  V,  as  the  following  comparison  will  show: 

TABLE  VIA.      MEDIAN  I.  Q.'s  BY  GROUPS 


Out  at  Work 

Out,  Transferred  to 
Other  High  School 

Remaining  in 
Same  High  School 

/ 

2 

3 

4 

Table  V 

94 
96 

110 
110 

110 

Table  VI 

107 

TABLE  VIB.      PERCENT  OF  PUPILS  IN  EACH  GROUP 
WHOSE  I  Q.'s  WERE  BELOW  100 

Out  at  Work 

Out,  Transferred  to 
other  High  Schools 

Remaining  in 
Same  High  School 

/ 

2 

J 

4 

Table  V 

71.4 
62.4 

20.0 
25.0 

27  0 

Table  VI 

26  5 

The  agreement  between  the  two  tables  is  the  more  striking 
when  it  is  remembered  that  the  107  high-schools  pupils  of  Table  V 
were  all  first-year  pupils  when  the  tests  were  given,  while  the  955 
pupils  of  Table  VI  comprise  all  the  classes  of  five  different  schools. 

The  tendency,  noted  in  the  discussion  of  Table  II,  for  girls 
to  make  lower  scores  on  the  Army  Scale  than  boys  accounts  for 
the  5.5  percent  of  pupils  with  I.  Q.'s  of  80-89  who  appear  in  the 
"out  by  graduation"  group.  These  four  pupils  were  all  girls, 
and  their  average  rating  in  school  work  was  83  percent. 

Table  VII  indicates  how  school  marks  tend  to  correspond  to 
mental  level  as  indicated  by  I.  Q.'s  earned  in  the  Army  Scale  tests. 

Considering  the  "at  work"  cases,  it  appears  that  only  the 
three  highest  I.  Q.  groups  were  doing  a  passing  grade  of  work. 
Lack  of  mental  ability  was  perhaps  the  most  potent  cause  of 
elimination,  but  it  was  not  the  only  cause  operating  in  these 
cases.  When  interest  in  the  subjects  offered,  application,  and 
ambition  are  lacking,  high  scores  in  the  mental  tests  are  n 
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TABLE  VII.      AVERAGE  SCHOOL  MARKS  OF  955  HIGH-SCHOOL  PUPILS, 
DISTRIBUTED  ACCORDING  TO  THE  CAUSES  OF  LEAVING 


Cause  of  Leaving 

79 

L  Q.  or 

Lower 

80- 

89 

LQ. 

90- 

99 

LQ. 

100- 
109 
LQ. 

110- 

119 

LQ. 

120- 
129 
LQ. 

130 
I.  Q.  or 
Higher 

General 
Average 

i 

2 

3 

4 

5 

6 

7 

8 

9 

At  work 

65 
59 

64 
67 
83 

72 
76 
79 

66 

72 
84 

70 

82 
85 

75 
85 
84 

87 
86 
92 

71  3 

Transferred 

Graduated 

75.3 
84  5 

Average    marks    by 
1.  Q.  groups 

62.0 

71.3 

75.6 

74.0 

79.0 

81.3 

88.3 

77.3 

necessary  guarantee  of  school  success.  Turning  now  to  the 
pupils  transferred  to  other  high  schools,  it  appears  that  they  made 
better  average  marks  under  every  I.  Q.  group,  except  the  very 
lowest,  than  did  the  "at  work"  pupils;  but  it  is  evident  that 
some  of  them  transferred  to  other  high  schools  because  of  failure 
in  school  work.  Later  checking  up  will  no  doubt  find  them  out 
of  school  entirely.  All  of  the  cases  in  the  "out  by  graduation" 
group  show  high  average  school  marks,  even  those  whose  I.  Q.  is 
between  80  and  89.  These  are  the  same  four  cases  discussed  in 
connection  with  Table  VI.  They  illustrate  how  necessary  it  is 
for  those  employing  mental  tests  to  be  conservative  in  accepting 
the  results  of  any  single  test  as  final. 

When  the  school  marks  earned  by  all  of  these  "out"  groups 
are  averaged  a  series  of  marks  is  obtained,  ascending  gradually 
from  the  lowest  to  the  highest  I.  Q.  ratings,  which  indicates  a 
definite  tendency  for  the  quality  of  school  work  to  correspond  to 
the  mental  level  indicated  by  the  Army  Scale  tests. 

A  further  following  up  of  the  153  who  graduated  from  the  five 
high  schools  between  September,  1917  and  April,  1919,  brought 
out  the  fact  that  94  of  them  were  continuing  their  education  in 
college,  university,  or  normal  school.  The  median  I.  Q.  of  those 
going  on  to  higher  educational  institutions  was  found  to  be  116. 
One  high-school  girl,  who  earned  an  I.  Q.  of  140  on  the  Army 
Scale,  graduated  from  the  San  Mateo  high  school  at  the  age  of 
fourteen  years  and  five  months.     Because  of  the  minimum  age 
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limit  of  fifteen  years  for  entrance  to  the  university,  she  was  com- 
pelled to  wait  seven  months  before  continuing  her  education. 
Had  her  case  been  included  in  the  "at  college"  group,  the  median 
I.  Q.  would  have  been  118. 

Taking  into  account  all  of  the  cases  of  high-school  pupils 
tested  either  by  the  individual  or  group  method  of  mental  exami- 
nation we  find  the  following  ascending  scale  of  median  I.  Q.'s  as 
a  further  indication  that  the  psychological  tests  disclosed  the 
approximate  mental  level  of  the  cases  discussed  in  the  foregoing 
tables:  first-year  high-school  pupils,  median  I.  Q.,  105;  high- 
school  graduates,  111;  those  going  on  to  college,  116. 

Summary 

1.  Individual  and  group  mental  tests  of  the  types  describe  d 
have  been  shown  to  be  sufficiently  reliable  to  justify  their  use  as 
aids  in  determining  the  mental  level  of  high-school  pupils. 

2.  Group  tests,  such  as  Army  Scale  Examinations  a  and 
Alpha,  make  possible  a  preliminary  mental  survey  of  an  entire 
high-school  population  at  the  beginning  of  a  school  year.  The 
resulting  raw  scores  will  be  found  to  be  of  great  value  in  grouping 
the  pupils  according  to  ability.  Such  tests  should  always  be 
supplemented  with  every  other  possible  means  of  discovering 
the  mental  level.  The  results  should  be  considered  tentative  and 
subject  to  revision  in  the  light  of  later  developments. 

3.  The  high-school  principal  who  makes  such  a  preHminary 
mental  survey  of  his  pupils  can  be  reasonably  sure  that  50  percent 
of  those  who  test  below  normal  will  be  eliminated  within  the 
first  two  years;  that  25  percent  additional  of  the  subnormal 
group  will  have  been  transferred  to  other  high  schools  because  of 
failure  in  their  school  work;  and  that  a  negligible  number  will 
ever  graduate.  With  this  information  at  hand  he  can  plan  the 
curriculums  of  his  pupils  more  intelligently.  Discovering  at  the 
outset  that  from  15  to  30  percent  of  his  pupils  are  incapable  of 
succeeding  in  the  conventional  high-school  subjects,  he  will 
undertake  to  make  new  adjustments  to  meet  the  situation.  There 
will  be  fewer  failures;  more  pupils  will  remain  to  take  work  that 
is  adapted  to  their  needs  and  capacities;  and  the  high  school  will 
be  less  open  to  the  charge  of  catering  only  to  the  intellectual 
aristocracy  among  its  pupils. 


RETARDATION  IN  ONE-ROOM  RURAL 
SCHOOLS  IN  KANSAS 

F.  J.  Kelly,  University  of  Kansas 

AND 

A.  K.  LooMis,  Principal,  Sumner  County  High  School,  Wellington,  Kansas 

In  1918  Kansas  still  had  147,889  children  enrolled  in  one-room 
rural  schools  out  of  a  total  of  405,319  children  enrolled  in  all 
public  schools.  Of  those  in  one-room  schools  about  72  percent 
were  enrolled  in  schools  having  terms  of  seven  months  and  almost 
all  of  the  remaining  28  percent  in  schools  having  terms  of  eight 
months.  The  course  of  study  in  all  these  one-room  rural  schools 
is  made  out  on  a  nine-year  basis;  and,  if  the  children  keep  up  with 
their  classes,  they  are  therefore  still  required  to  spend  nine  years 
to  complete  the  course.  Practically  all  schools  in  the  towns  and 
cities,  on  the  other  hand,  have  terms  of  nine  months.  The  study 
here  reported  was  one  of  a  group  of  studies  undertaken  in  the 
hope  of  reducing  this  inequahty  of  opportunity. 

In  February,  1917  with  the  cooperation  of  the  state  superin- 
tendent and  the  county  superintendents  concerned,  pupil's  cards 
containing  the  following  questions  were  sent  to  the  teachers  of 
all  one-room  rural  schools  in  fourteen  typical  counties  in  Kansas. 

PUPIL'S  CARD 

1 .  Are  you  a  boy  or  a  girl? 

2.  What  is  your  name? 

3.  How  old  were  you  at  your  last  birthday? 

4.  In  what  month  were  you  born? 

5.  In  what  year  were  you  born? 

6.  In  what  grade  are  you  now? 

7.  Do  you  take  all  your  studies  in  the  same  grade? 

8.  Have  you  ever  attended  any  other  school? 

9.  Does  your  father  own  the  farm  on  which  you  live? 

10.  Do  you  intend  to  go  to  high  school? 

11.  If  you  are  a  boy,  do  you  intend  to  be  a  farmer? 

A  sufficient  supply  of  the  cards  was  sent  so  that  each  teacher  had 
one  for  each  pupil  in  her  school. 

Along  with  these  cards,  the  following  teacher's  card  was  sent: 
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TEACHER'S  CARD 

1.  County 

2.  District  No 

3.  Teacher's  name 

4.  Teacher's  address 

5.  How  many  pupils  are  NOW  on  roll? 

(Do  not  give  enrollment  from  first  of  the  year) 

6.  Have  you  examined  every  pupil's  card  in  regard  to  the  three  points 

mentioned  in  the  directions  for  the  teacher? 

7.  How  many  months  of  school  does  this  district  have  this  year? 

8.  How  many  months  of  school  did  this  district  have  last  year? 

9.  How  far  is  it  from  this  school  house  to  the  nearest  high  school? 

10.  How  many  years  have  you  taught  this  school  before  this  year? 

11.  What  is  your  monthly  salary? 

12.  State  exactly  what  kind  of  certificate  you  hold 

13.  How  many  years  of  teaching  experience  have  you  had  before  this  year? 

14.  Are  you  a  high-school  graduate 

15.  If  not  a  high-school  graduate,   how  many  weeks  have  you  attended 

high  school? 

16.  Have  you  attended  a  state  normal  school? 

17.  If  so,  how  many  weeks? 

18.  Have  you  attended  a  college  or  university? 

19.  If  so,  how  many  weeks? 

(over) 

On  the  reverse  side  of  the  teacher's  card  the  following 
instructions  were  printed : 

TEACHER'S  CARD  {Reverse  Side) 

To  the  teachers  of  one-teacher  rural  schools: 

With  the  approval  of  State  Supt.  W.  D.  Ross  and  Mr.  J.  A.  Shoemaker, 
one  of  the  Rural  School  Supervisors,  I  am  undertaking  to  make  a  study  of 
certain  conditions  in  the  one-teacher  rural  schools  of  Kansas.  Your  county 
superintendent  is  heartily  in  favor  of  the  plan  and  I  am  certain  that  you  wiU 
be  willing  to  let  the  children  fill  out  the  enclosed  cards  at  your  first  oppor- 
tunity. The  information  that  I  have  asked  for  on  the  teacher's  card  is  very 
important.    The  teacher's  card  is  printed  on  the  other  side  of  this  sheet. 

If  you  will  assist  in  this  study,  please  notice  the  following  directions 
carefully  before  letting  the  children  fill  out  the  cards. 


Directions  for  the  Teachers 
Let  the  children  fill  out  the  cards  if  they  are  old  enough  to  do  it  correctly, 
otherwise  please  fill  them  out  yourself.    If  you  haven't  received  enough 
cards  for  all  pupils  use  the  cards  for  the  older  pupils,  but  please  report  the 
sex,  name,  age,  and  grade  of  every  pupil  for  whom  you  send  in  no  card. 
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Examine  the  cards  after  the  children  have  filled  them  out  to  make  cer- 
tain of  the  following  three  points: 

1.  That  every  question  has  been  answered. 

2.  That  the  answer  to  question  three  agrees  with  the  answers  to  ques- 

tions four  and  five. 

3.  That  question  six  is  answered  correctly. 

N.  B.  IN  ANSWERING  QUESTION  SIX,  COUNT  A  PUPIL  WHO 
TAKES  HIS  WORK  IN  MORE  THAN  ONE  GRADE  IN  THAT  GRADE 
IN  WHICH  HE  TAKES  MOST  OF  HIS  WORK. 

Please  fill  out  your  own  card  carefully,  answering  every  question. 
Return  the  cards  to  me  in  the  enclosed  stamped  envelope  within  a  week 
from  the  time  you  receive  them  if  possible. 

Very  truly  yours, 
1110  Vermont  St.  A.  K.  Loomis 

Lawrence,  Kansas. 

(over) 

It  seems  sure  from  these  detailed  instructions  that  the  data 
given  by  the  children  were  thus  rendered  reasonably  accurate. 

Of  the  fourteen  counties,  eleven  sent  in  returns  in  time  to 
be  tabulated  for  this  study.  Of  all  the  teachers  of  one-room 
rural  schools  in  these  eleven  counties  54  percent  sent  in  reports 
of  all  their  children.  The  range  of  schools  responding  was  from 
30  percent  in  one  county  to  81  percent  in  another.  The  total 
number  of  pupil's  cards  received  was  10,298,  of  which  5,267  were 
boys'  cards  and  5,031  were  girls'  cards.  All  the  tabulations  from 
these  cards  were  made  by  Mr.  Loomis  and  not  by  the  teachers 
concerned. 

Among  the  questions  which  the  study  undertakes  to  answer  are : 

1.  What  is  the  percentage  of  seven-month  one-room  schools 
and  eight-month  one-room  schools  by  counties?     (See  Fig.  1.) 

2.  What  is  the  amount  of  retardation  in  these  one-room  rural 
schools  by  counties,  by  ages,  by  grades,  and  by  sexes?  (See  Figs. 
2,  4,  and  6.) 

3.  How  does  this  retardation  compare  with  retardation  in 
city  schools  in  Kansas?     (See  Figs.  3,  5,  and  7,  and  Table  II.) 

4.  How  does  the  retardation  in  seven-month  schools  compare 
with  the  retardation  in  eight-month  schools?     (See  Fig.  8.) 

5.  What  is  the  cost  of  this  retardation  in  terms  of  ambition 
for  higher  education?     (See  Fig.  9.) 

6.  What  percentage  of  the  children  have  spent  their  school 
lives  in  one  school  only,  and  what  effect  has  the  moving  from  one 
school  to  another  had  upon  retardation?     (See  Figs.  10  and  11.) 


274 


JOURNAL  EDUCATIONAL  RESEARCH 


Vol.  J,  No.  4 


7.  What  is  the  money  cost  of  retardation  in  one-room  rural 
schools?     (See  concluding  paragraph.) 

8.  What  is  the  money  cost  of  the  nine-year  course  of  the  one- 
room  rural  school  as  compared  with  the  eight-year  course  of  the 
city  school?     (See  concluding  paragraph.) 

The  answers  to  the  above  questions  are  largely  contained  in 
the  tables  and  figures  given  on  the  following  pages. 

TABLE  I.   THE  NUMBER  AND  PERCENT  OF  SCHOOLS  REPORTING, 
AND  THE  TOTAL  CARDS  RECEIVED  BY  COUNTIES 


County 

A 

B 

C 

D 

E 

F 

G 

H 

K 

L 

M 

Total 

No.  of  one-room  rural 
schools 

78 

63 

81 

710 

667 

125 

82 

66 

809 

742 

91 

37 

41 

377 

400 

98 

59 

60 

624 

690 

91 

27 

30 

241 

223 

113 
66 

58 
651 
608 

89 

'47 

53 

359 

302 

68 

43 

63 

390 

362 

72 

43 

60 

379 

375 

106 

51 

48 

396 
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Figure  1  should  be  read:  County  E  has  6  percent  of  its  children 
for  whom  cards  were  received  in  eight-month  schools,  while 
County  H  has  54  percent  in  eight-month  schools.  The  average 
of  the  eleven  counties  is  also  shown.  Twenty-eight  percent  of 
the  one-teacher  rural  schools  of  the  whole  state  have  an  eight- 
month  term.     Practically  all  others  have  seven-month  terms. 
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FIGURE    2.      RETARDATION   AND   ACCELERATION   IN   54   PERCENT 

OF  THE  ONE-TEACHER  RURAL  SCHOOLS  IN  ELEVEN   COUNTIES 

IN  KANSAS,  ENROLLING  10,298  CHILDREN 
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Figure  2  should  be  read:  County  M  has  a  retardation  of  30 
percent  and  an  acceleration  of  6  percent.  The  average  of  the 
eleven  counties  is  shown,  also  the  average  for  twelve  cities  in 
Kansas  in  June,  1916.  Normal  age  in  grade  i  is  six  or  seven  at 
the  end  of  school;  grade  ii,  seven  or  eight;  grade  ni,  eight  or  nine. 
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FIGURE  3.      RETARDATION  AND  ACCELERATION  IN  TWELVE 
CITIES  IN  KANSAS,  ENROLLING  28,443  CHILDREN 
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Figure  3  should  be  read:  City  P  has  a  retardation  of  12.8 
percent  and  an  acceleration  of  18.5  percent.  The  average  of  the 
twelve  cities  is  shown,  also  Cubberley's  estimate  of  the  condition 
under  a  properly  adjusted  course  of  study.  The  high  school  is 
included  in  all  except  N  and  O.  Normal  age  in  grade  i  is  6  or  7 ; 
grade  ii,  7  or  8;  grade  iii,  8  or  9,  etc. 

FIGURES  4a  and  4b.      RETARDATION  AT  EACH  AGE  FROM  EIGHT 

TO  FIFTEEN  IN  THE  ONE-TEACHER  RURAL  SCHOOLS  IN 

ELEVEN  COUNTIES  IN  KANSAS 
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Figure  4a.     Boys 
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Figures  4a  and  4b  should  be  read:  24  percent  of  eight-year-old 
boys  are  retarded  and  19  percent  "of  eight-year-old  girls.  The 
average  for  these  ages  is  also  shown. 


FIGURES  5a  and  5b.      RETARDATION  AT  EACH  AGE  FROM  EIGHT 

TO  EIGHTEEN  IN  TEN  CITIES  IN  KANSAS, 

ENROLLING  26,608  CHILDREN 
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Figure  5a.     Boys 
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Figure  5b.     Girls 

Read  Figures  5a  and  5b  as  follows:  16.1  percent  of  eight-year- 
old  boys  are  retarded,  9.8  percent  of  eight-year-old  girls  are 
retarded. 


FIGURES  6a  and  6B.      RETARDATION  IN  THE  DIFFERENT  GRADES 

OF  THE  ONE-TEACHER  RURAL  SCHOOLS  IN 

ELEVEN  COUNTIES  IN  KANSAS 
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Figure  6a.    Boys 
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Figure  6b.     Girls 

Figures  6a  and  6b  should  be  read:  In  grade  iii  39  percent  of 
the  boys  are  retarded  and  30  percent  of  the  girls.  The  average 
for  all  grades  is  also  shown. 

FIGURES  7a  AND  7b.      RETARDATION  IN  THE  DIFFERENT  GRADES 

OF  THE  ELEMENTARY  SCHOOLS  IN  TWELVE 

CITIES  IN  KANSAS 
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Figure  7a.     Boys 
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Figure  7  b.     Girls 
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Figures  7a  and  7b  should  be  read:  In  grade  iii  32.1  percent 
of  the  boys  are  retarded,  and  23.4  percent  of  the  girls  are  retarded. 


TABLE  II.      COMPARISON  OF  ONE-ROOM  RURAL  SCHOOLS  AND  CITY 

SCHOOLS  IN  RESPECT  TO  THE  PROPORTION  OF  PUPILS 

RETARDED  ONE  YEAR  AND  MORE  THAN  ONE  YEAR 
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FIGURE     8.      RETARDATION     IN     THE     SEVEN-MONTH      SCHOOLS 

COMPARED  WITH  RETARDATION  IN  THE 
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Figure  8  should  be  read:  36  percent  of  boys  attending  eight- 
month  schools  are  retarded,  while  47  percent  of  boys  attending 
seven-month  schools  are  retarded. 
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FIGURE  9.      PERCENT  OF  NORMAL  AND  ACCELERATED  CHILDREN 
WHO  DO  NOT  INTEND  TO  GO  TO  HIGH  SCHOOL  COM- 
PARED WITH  PERCENT  OF  RETARDED  CHILDREN 
WHO  DO  NOT  INTEND  TO  GO  TO  HIGH  SCHOOL 
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Figure  9  should  be  read:  37  percent  of  normal  and  accelerated 
boys  do  not  intend  to  go  to  high  school,  46  percent  of  boys  who 
are  retarded  one  year  do  not  intend  to  go  to  high  school,  etc. 
Included  in  this  comparison  are  3,990  children  twelve  years  old 
or  older. 

FIGURE  10.      RETARDATION  AMONG  THE  CHILDREN  OF 

LANDOWNERS  COMPARED  WITH  RETARDATION 
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All  children  twelve  or  thirteen  years  of  age  who  have  attended 
only  one  school  are  included  in  this  comparison.  Figure  10  should 
be  read:  49  percent  of  twelve  and  thirteen-year-old  boys  whose 
fathers  own  farms  are  retarded,  and  51  percent  of  those  whose 
fathers  are  tenants  are  retarded. 

The  comparison  is  based  on  children  who  have  attended  only 
one  school  in  order  to  exclude  from  consideration  at  this  point 
the  effect  of  changing  from  one  school  to  another.  Twelve  and 
thirteen-year-old  children  were  used  to  avoid  a  fallacy  resulting 
from  using  children  of  all  ages.  It  is  evident  that  the  average 
age  of  all  children  who  have  attended  only  one  school  and  whose 
fathers  are  tenants  is  less  than  the  average  age  of  all  children  who 
have  attended  only  one  school  and  whose  fathers  own  farms. 
This  follows  from  the  fact  that  among  children  of  tenants  the 
proportion  who  have  attended  but  one  school  decreases  with  the 
age  of  the  children  much  more  rapidly  than  it  does  among  children 
of  farm  owners.  Since  retardation  increases  rapidly  with  age, 
the  children  of  tenants  fallaciously  seem  less  retarded  than  the 
children  of  landowners  when  children  of  all  ages  are  included. 


FIGURE  11.   RETARDATION  AMONG  CHILDREN  WHO  HAVE 
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All  children  twelve  or  thirteen  years  of  age  whose  fathers  are 
tenants  are  included  in  this  comparison.  Figure  11  should  be 
read:  51  percent  of  twelve  and  thirteen-year-old  boys  who  have 
attended  only  one  school  are  retarded,  and  61  percent  of  those 
who  have  attended  more  than  one  school  are  retarded. 
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The  Money  Cost 

There  remains  the  task  of  calculating  the  costs  of  retardation 
and  of  conducting  seven  and  eight-month  schools  for  nine  years. 
Attention  is  first  called  to  the  significance  of  a  few  of  the  main 
points  involved. 

Let  it  be  understood  that  in  figuring  retardation  exactly  the 
same  blank  was  used  in  city  schools  and  country  schools,  so  that 
the  data  are  entirely  comparable.  We  wish  to  repeat,  however, 
that  country-school  children  are  considered  of  normal  age  for 
grade,  if  they  complete  the  elementary-school  course  before  they 
have  become  sixteen,  while  city  children  are  regarded  as  one 
year  retarded  when  they  complete  the  elementary-school  course 
at  fifteen.  It  is  clear,  therefore,  that  country-school  children 
from  the  first  grade  through  the  ninth  have  progressively  a  larger 
part  of  a  year  the  advantage  of  city  children  before  being  classified 
as  retarded.  In  spite  of  this  fact,  it  is  noted  that  country  children 
have  8  percent  greater  retardation  as  a  whole  than  city  children. 
Not  only  is  that  true  but  this  difference  is  much  greater  than  8 
percent  among  the  upper  ages.  For  example,  while  51 .9  percent 
of  fifteen-year-old  city-school  boys  are  retarded,  71  percent  of 
fifteen-year-old  country-school  boys  are  retarded,  and  while  42 . 7 
percent  of  fifteen-year-old  city-school  girls  are  retarded,  65  percent 
of  fifteen-year-old  country-school  girls  are  retarded.  It  should 
be  noted,  however,  that  the  difference  is  less  than  8  percent  when 
the  ninth  grade  of  the  rural  school  is  compared  with  the  eighth 
grade  of  the  city  school.  This  indicates  that  the  elimination  is 
very  much  greater  in  the  country  school  than  in  the  city  school. 

Attention  is  also  directed  to  the  fact  that  while  31  percent  of 
all  children  in  eight-month  schools  are  retarded,  42  percent  of  all 
children  in  seven-month  schools  are  retarded,  a  difference  of  11 
percent.  This  means  that  of  the  present  enrollment  in  one-room 
rural  schools  in  Kansas,  practically  thirteen  thousand  are  retarded 
in  seven-month  schools  who  would  not  be  retarded  if  they  were 
in  eight-month  schools.  Inasmuch  as  only  37  percent  of  boys  of 
normal  age  for  grade  of  twelve  years  of  age  or  above  do  not 
intend  to  go  to  high  school,  whereas  46  percent  of  those  retarded 
for  one  year  and  61  percent  of  those  retarded  more  than  one  year 
do  not  intend  to  go  to  high  school,  the  relationship  between 
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retardation  and  ambition  to  go  to  high  school  is  direct.  We 
recognize,  of  course,  that  many  children  retarded  are  not  mentally 
fitted  for  high-school  work  and  that  retardation  in  their  cases  is 
not  the  cause  of  their  lack  of  ambition.  But  in  the  case  of  the  1 1 
percent  who  are  retarded  in  seven-month  schools,  who  would  not 
be  retarded  if  they  were  in  eight-month  schools,  it  may  be  con- 
fidently stated  that  retardation  is  the  definite  cause  of  the  absence 
of  ambition  to  go  to  high  school  in  a  considerable  proportion  of 
their  cases. 

Assuming  that  a  boy  or  girl  of  thirteen  or  more  years  is  worth 
$150  a  year  as  a  producer,  neglecting  the  loss  as  producers 
resulting  from  longer  attendance  of  children  each  year  between 
six  and  fourteen,  and  using  thirteen-year-old  pupils  as  a  basis, 
the  annual  loss  because  of  retardation  in  the  one-room  rural 
schools  of  Kansas  is  above  $1,800,000.  One-fourth  of  this 
amount,  or  $450,000,  is  due  to  the  excessive  retardation  produced 
by  seven-month  schools  above  what  would  occur  if  these  schools 
were  increased  to  eight  months.  The  total  cost  of  increasing 
every  seven-month  course  in  Kansas  to  eight  months  would  be 
approximately  $450,000.  It  is  clear,  therefore,  that  the  actual 
saving  of  time  in  retardation  alone  would  pay  the  cost  of  making 
every  seven-month  school  into  an  eight-month  school. 

Again  considering  the  value  of  a  child  thirteen  years  old  and 
older  at  $150  per  year,  the  loss  incurred  in  having  country-school 
pupils  required  to  attend  nine  years  to  complete  the  same  course 
of  study  which  would  be  completed  in  eight  years  (if  the  terms 
were  lengthened  from  seven  or  eight  months  to  nine  months  as 
in  the  city  schools)  can  be  estimated  at  $2,700,000  per  year.  It 
would  cost  about  $1,000,000  a  year  to  increase  every  seven  and 
eight-month  school  to  a  nine-month  school.  There  would  be  a 
saving  of  $1,700,000  on  this  score. 

Naturally  a  very  much  larger  proportion  of  the  children  would 
complete  the  elementary-school  course  if  it  were  only  eight  years 
in  length  rather  than  nine,  thus  securing  very  much  larger  advan- 
tages of  education  than  are  now  possible  to  country  children. 
Kansas  is  therefore  paying  very  dearly  indeed  in  money,  in  edu- 
cational opportunity,  and  in  ambition,  by  persisting  in  maintain- 
ing country  schools  of  seven  and  eight-month  terms. 


A  GROUP  SCALE  OF  INTELLIGENCE  FOR  USE  IN  THE 

FIRST  THREE  GRADES:  ITS  VALIDITY 

AND  RELIABILITY 

LuELLA  Winifred  Pressey 
Indiana  University 

I.  The  Statistical  Problems  Presented  by  the  Scale 
In  a  recent  number^  of  the  Journal  of  Educational  Psychology, 
the  writer  has  presented  a  general  descriptive  account  of  the 
purpose,  nature,  and  development  of  the  "Primer  Scale."  At  the 
time  of  writing  that  paper,  little  statistical  evidence  had  been 
gathered  as  to  the  "validity"  and  "reliability"  of  the  scale. 
By  "vahdity"  the  writer  means  the  extent  to  which  the  scale 
measures  what  it  is  supposed  to  measure — i.e.,  general  intelli- 
gence; by  "rehability"  is  meant  the  consistency  or  accuracy  of 
the  measures  obtained.  Thus,  a  scale  might  give  very  consistent 
measures  that  were  not  valid — that  did  not  measure  the  qualities 
the  scale  was  designed  to  measure — or,  a  scale  might  give  reason- 
ably valid  measures  of  some  quality,  but  the  measures  might  be  so 
inconsistent  as  to  make  the  scale  largely  unsatisfactory.  In 
other  words,  these  two  characteristics  of  a  scale  might  exist  in 
varying  combinations  with  each  other  and  should  be  kept  separate 
in  considering  the  value  of  the  results.  It  is  the  purpose  of  the 
present  paper  to  present  the  evidence  that  has  been  found,  thus 
far,  bearing  on  these  two  important  points  of  (1)  the  validity  and 
(2)  the  reliability  of  the  Primer  Scale. 

II.  The  Validity  of  the  Primer  Scale 
1.  Sources  of  data. — For  a  general  description  of  the  four 
tests  composing  the  scale,  the  reader  is  referred  to  the  above 
mentioned  article.  It  may  be  briefly  said  that  the  first  test  is 
one  of  form  discrimination  in  which  dots  are  arranged  in  patterns; 
the  second  is  a  test  of  similarities  and  differences,  using  pictures 
of  familiar  objects  as  materials;  the  third  is  a  form  board  test, 
arranged  so  that  it  can  be  presented  on  paper;  and  the  fourth  is 
a  test  of  absurdities,  again  using  pictures. 

'  Pressey,  L.  W.    "A  group  scale  of  intelligence  for  use  in  the  first  three  grades," 
Journal  of  Educational  Psychology,  10:297-308,  September,  1919. 

285 


286  JOURNAL  EDUCATIONAL  RESEARCH  Vol.  1,  No.  4 

The  tests  have  been  given  to  about  twenty-five  hundred 
public  school  children  (June,  1919)  in  the  first  three  grades;'^ 
also  to  64  "children"  with  a  mental  age  on  the  Stanford-Binet 
Scale  of  between  six  and  eight  in  the  state  school  for  the  feeble- 
minded in  Minnesota.  Many  of  the  school  children  tested  had 
been  previously  "Bineted." 

2.  Methods. — The  writer  has  used  three  methods  for  arriving 
at  a  conclusion  concerning  the  validity  of  the  scale.  (1)  One 
hundred  and  twenty  children  who  had  been  "Bineted"  were 
divided  into  five  groups  on  the  basis  of  their  Intelligence  Quo- 
tients (I.  Q.'s)  as  determined  by  their  scores  in  the  Binet  Scale 
(Stanford  Revision).  The  scores  of  these  groups  in  the  Primer 
Test  were  then  examined  for  consistency  with  the  groupings 
according  to  the  Binet  ratings.  (2)  Three  correlations  with  the 
Binet  ratings  were  calculated:  first,  the  correlation  between  the 
Binet  "mental  age"  and  the  Primer  Test  score  for  the  64  institu- 
tional feeble-minded  cases;  second,  a  similar  correlation  for  148 
children  in  the  primary  grades  of  Council  Bluffs,  Iowa;  and  third, 
a  correlation  for  57  unselected  six-year-old  children  in  the  first 
grade  at  Washington,  Indiana.  (3)  The  writer  chose  this  last 
group  for  a  more  detailed  analysis  by  the  method  of  partial 
correlation.  The  separate  tests  were  intercorrelated,  each  test 
was  correlated  with  the  Binet  ratings,  and  the  partial  coefficients 
and  regression  equation  were  calculated. 

3.  Results. — The  results  of  the  first  method  are  indicated  in 
Table  I  which  gives  the  distribution  of  scores  on  the  Primer  Scale 
of  120  unselected  six-year-old  children,  for  whom  the  writer  had 
Binet  ratings.  The  cases  have  been  divided  into  five  groups  on 
the  basis  of  the  Binet  I.  Q's.  Group  I  (the  first  column)  includes 
the  scores  of  those  children  with  an  I.  Q.  of  125  or  above;  Group  II 
contains  those  children  who  obtain  an  I.  Q.  of  110-124;  Group  III 
those  with  an  I.  Q.  from  90-109;  Group  IV  those  from  76-89;  and 
Group  V  those  with  an  I.  Q.  below  76.  The  five  groups  might  be 
termed,  very  superior,  superior,  average,  inferior,  very  inferior. 

There  is  some  over  lapping  from  one  group  to  another,  but 
the  only  distribution  for  which  the  amount  of  over  lapping  is  sur- 
prising is  that  of  the  "average"  group  (Group  III)  whose  distribu- 

*The  writer  wishes  to  express  her  obligations  to  the  school  superintendents  of 
Washington,  Bedford,  and  Bloomington,  Indiana,  and  of  Council  Bluffs,  Iowa;  also, 
to  Dr.  F.  Kuhlmann,  Psychologist  of  the  School  for  the  Feebleminded  at  Faribault, 
Minnesota  for  the  materials  here  presented. 
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tion  over  laps  that  of  every  other  group.  The  two  extreme 
groups  (I  and  V)  are  quite  distinct  from  each  other — that  is,  the 
lowest  score  in  Group  I  is  above  the  highest  score  in  Group  V. 
With  the  exception  of  one  case,  Groups  I  and  II  combined  (i.e., 
the  really  bright  children  according  to  the  Binet  Scale)  show  no 
over  lapping  of  test  scores  with  the  Groups  IV  and  V  combined 
(i.e.,  with  the  really  dull  children).  The  horizontal  hues  in 
Table  I  show  the  location  of  the  7  5 -percentile,  the  median  and 
the  2 5 -percentile  for  the  total  distribution  of  these  unselected  chil- 
dren— i.e.,  the  standard  norms  derived  from  the  complete  surveys 
made.  As  will  be  seen,  the  children  in  Group  I  make  no  scores 
below  the  75-percentile  for  their  age,  while  the  children  in  Group 
V,  with  one  exception,  make  no  scores  above  the  25-percentile. 
The  lowest  group  is  the  most  compact  of  the  five.  There  is, 
in  general,  not  as  much  over  lapping  of  one  group  upon  the  other 
at  the  lower  end  of  the  distribution  as  at  the  upper  end.  This  is 
understandable,  as  the  brilliant  children  might  not  give  their  best 
performance  and  would  thus  make  a  lower  score  than  they  really 
should;  while,  on  the  other  hand,  it  is  not  to  be  expected  that 
adventitious  circumstances  would  cause  a  dull  child  to  be  rated 
too  high  to  the  same  degree.  On  the  whole,  the  Primer  Scale 
seems  to  have  marked  off  degrees  of  ability  as  well  as  could  be 
expected  of  a  group  test  given  to  such  young  children.  In  this 
connection,  it  might  be  emphasized  that  some  six-year-old  children 
who  make  a  low  score  on  a  group  test  receive  a  higher  rating  on 
the  Binet  examination  because  of  the  very  different  testing  environ- 
ment. This  aids  in  explaining  the  dropping  down  of  scores  in 
the  first  three  groups  into  the  distributions  of  the  lower  groups. 
Some  of  the  children  making  these  scores  lack,  not  intelUgence, 
but  independence.  When  asked  to  perform  certain  tasks  in  a 
group,  they  do  not  have  the  initiative  to  do  their  best;  whereas 
they  show  a  Binet  rating  more  nearly  commensurate  with  their 
true  intelligence,  because  the  examiner  can  constantly  recall 
their  attention  and  their  efforts  to  the  task  in  hand.  The  writer 
feels  that  the  relationship  shown  in  Table  I  is  probably  as  high 
as  can  be  expected  between  a  group  test  and  an  individual  test,' 
especially  with  such  young  children. 

*  Lowell,  Frances.  "A  group  intelligence  scale  for  primary  grades,"  Journal  of 
Applied  Psychology,  3:215-48,  September,  1919.  The  scale  described  in  this  article 
is  a  group  form  of  the  younger  years  of  the  Binet;  yet  the  correlation  between  group 
score  and  the  rating  on  the  Binet  Scale  when  given  to  the  same  children  individually 
is  only +0.75. 
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TABLE  I.      THE  DISTRIBUTION  OF  SCORES  MADE  BY  1 20  SIX-YEAR-OLD 

CHILDREN  ON  THE  PRIMER  SCALE,  GROUPED  ACCORDING 

TO  I.  0-  ON  THE  STANFORD-BINET  SCALE 


Group  I 

Group  V 

Primer 

(LQ. 

Group  II 

Group  III 

Group  IV 

(LQ. 

Scale 

above 

(LQ. 

(LQ. 

(I.Q. 

below 

Scores 

125) 

110-124) 

90-109) 

76-89) 

76) 

/ 

2 

3 

4 

5 

80 

1 

78 

76 

74 

72 

2 

1 

70 

1 

68 

66 

1 

2 

64 

1 

1 

1 

62 

4 

4 

2 

60 

3 

2 

1 

58 

2 

2 

3 

56 

4 

1 

4 

54 

1 

4 

52 

5 

50 

1 

1 

48 

2 

2 

1 

/  J  "^cTC'Ct**' WC 

46 

3 

3 

1 

44 

5 

42 

2 

4 

40 

1 

2 

38 

1 

3 

36 

2 

1 

34 

1 

32 

1 

30 

2 

28 

4 

1 

26 

24 

2 

22 

20 

1 

18 

bJ^yCrcCTlllrlC 

16 

1 

1 

14 

2 

2 

12 

10 

1 

2 

8 

1 

2 

6 

1 

1 

1 

4 

1 

2 

1 

0 

3 

No.  cases .  . . 

21 

25 

58 

8 

8 

Medians 

61 

55 

45 

11 

4 
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The  second  method  of  studying  the  validity  of  the  Primer 
Scale  involved  the  calculation  of  the  Pearson  coefficient  of  correla- 
tion between  scores  derived  from  it  and  scores  obtained  by  using 
the  Binet  Scale.  The  crude  coefl&cients  of  correlation  for  each 
of  the  three  groups  of  children  are  as  follows: 

64  children  from  a  feeble-minded  school  +0.75 

148  children  in  primary  grades  4-0.66 

57  unselected  children  6  years  of  age        +0.62 

In  all  cases,  the  correlation  is  between  group  test  scores  and 
"mental  ages"  on  the  Binet  examination.'*  The  correlations  are, 
the  writer  feels,  as  high  as  can  be  expected  from  the  very  different 
nature  of  the  testing  conditions  for  the  two  types  of  tests  (group 
and  individual). 

The  scores  of  the  57  unselected  six-year-old  children  were 
subjected  to  further  analysis  by  means  of  partial  correlation. 
The  crude  coefficients  of  the  scores  of  each  of  the  four  tests  which 
make  up  the  Primer  Scale  with  each  other  and  with  the  Binet 
ratings  are  given  in  Table  II. 

TABLE     II.      CRUDE     COEFFICIENTS     OF     CORRELATION     BETWEEN 

TESTS  OF  THE  PRIMER  SCALE  AND  THE  BINET  SCALE, 

TAKEN  PAIR  BY  PAIR 

LEGEND 

l=Test  1,  Primer  Scale 
2=Test2,     " 

3  =  Test  3,     " 

4  =  Test  4,     " 

5  =  Binet  Scale 

This  table  should  be  read:  the  correlation  between  Tests  1  and  2  of  the  Primer 
Scale  was  found  to  be  0.59;  between  Tests  1  and  3,  0.48;  etc. 

It  will  be  noticed  that  the  coefficients  of  correlation  between 
the  tests  of  the  Primer  Scale  are  rather  high,  except  between  the 
third  and  fourth.     Because  of  this  difference  in  the  relationship 

*  The  I.  Q.,  which  is  frequently  used  for  such  correlations,  is  a  percent  statement. 
No  similar  statement  was  readily  possible  with  the  Primer  Scale.  Therefore,  it  was 
necessary  to  use  total  scores  on  both  scales.  Even  in  correlating  the  scores  of  children 
of  the  same  age,  the  error  introduced  in  using  I.  Q.  is  considerable,  as  the  basis  for 
calculating  the  I.  Q.  may  range  (in  the  case  above)  from  6  years  and  0  months  to  6 
years  and  11  months — or  nearly  a  whole  year. 


Tests 

1 

2 

3 

4 

1 

2 

0.59 

3 

0.48 

0.46 

4 

0.57 

0.55 

0.33 

5 

0.53 

0.45 

0.42 

0.47 
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between  the  tests,  it  is  especially  desirable  to  find  the  partial 
correlations  of  each  test  with  the  Binet  Scale,  to  determine  just 
what  the  independent  value  of  each  test  might  be.  The  resulting 
partial  coefficients  of  correlation  are  as  follows: 

r»i.»s4  =0.2436 
f„.»,«=0.0951 
f.».. 4=0. 1834 
rs«.i«3  =0.2006 

These  partial  coefficients  should  be  read:  the  correlation  of  5 
(Binet  rating)  with  1  (Test  1),  the  other  three  tests  being  constant, 
is  0.2436;  of  Binet  rating  and  2  (Test  2),  the  other  three  tests 
being  constant,  is  0.0951. 

The  partial  coefficients  are  interesting  in  themselves  aside 
from  the  part  they  play  in  calculating  the  regression  equation.^ 
The  relative  standing  of  the  four  tests  in  their  relation  to  the 
Binet  Scale,  has  not  changed  materially  from  that  indicated  by 
the  original  correlations  (Table  II).  The  first  test  still  has  the 
highest  correlation,  and  the  order  of  decreasing  coefficients  is  now 
the  fourth,  the  third,  and  the  second  according  to  the  partial 
correlations  shown  above.  The  second  test  seems  to  contribute 
almost  nothing  to  the  correlation  of  the  whole  scale  with  the  Binet 
Scale,  which  is  not  already  contributed  by  some  other  test. 
When  the  other  tests  are  held  constant,  its  correlation  with  the 
Binet  Scale  becomes  practically  zero  (0.0951).  Thus,  the  second 
test  is,  according  to  this  criterion,  the  least  valuable  test  of  the 
scale*  and  the  first  test  is  the  most  valuable. 

III.    The  Reliability  of  the  Primer  Scale 
1.  Materials. — The  papers  of  all  the  children  in  the  first  and 
second  grades,  and  of  aU  the  six-  and  seven-year-old  children  in 

*  The  regression  equation  of  the  Binet  ratings  on  the  four  tests  of  the  scale  was 
found  to  be  the  following: 

«5 =0. 5719*1+0 .  2142*2+0 .  2844x,+0 .  5380x4, 
where  x  is  the  deviation  of  a  pupil's  score  in  Test  1  from  the  average,  x^  his  deviation 
from  the  average  in  Test  2,  etc.  x^  is  the  most  probable  deviation  from  the  average 
Binet  score.  The  scores  of  the  original  57  papers  used  in  the  derivation  of  the  equation 
were  weighted  in  accordance  with  the  above  equation.  This  weighting  raised  the 
correlation  from  0.62  to  0.65. 

*  Since  writing  the  above,  the  writer  has  tried  a  new  method  of  scoring  the  second 
test,  which  takes  account  of  possible  chance  successes,  and  has  obtained  a  correlation 
of  0.52  instead  of  0.45  as  given  in  Table  II.  This  difference  in  correlation  might 
make  some  difference  in  the  relative  standing  of  the  second  test  as  revealed  by  partial 
correlation. 
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the  city  most  recently  tested  were  chosen  as  the  material  from 
which  to  estimate  the  reliability  of  the  scale. 

2.  Methods. — The  degree  of  the  reliability  of  the  measures 
obtained  by  the  scale  and  of  its  separate  tests  has  been  calculated 
in  two  ways.  Coefficients  of  reliability  have  been  found 
for  each  of  the  four  groups  just  mentioned  (grades  i  and  n 
and  ages  six  and  seven).  As  there  was  only  one  form  of  the 
scale,  the  coefficients  of  reliability  were  calculated  by  dividing  the 
scale  into  halves  (using  alternate  items),  correlating  the  scores  of 
the  half  tests,  and  applying  Brown's  formula.''  This  formula 
represents  the  extent  to  which  the  amalgamated  results  of  two 
tests  would  correlate  with  a  similar  amalgamated  series  of  two 
other  applications  of  the  same  test.     The  formula  is : 

2ri 

H=- 

l+n 
Both  the  total  scale  and  each  test  have  been  treated  in  this  way 
for  the  four  age  and  grade  groups.  (2)  The  reliability  has  been 
calculated  in  terms  of  the  probable  error  (P.  E.),  by  the  following 
method.  Each  pupil's  score  on  one  half  of  the  scale  was  sub- 
tracted from  his  score  on  the  other  half.  These  differences  were 
then  averaged,  giving  an  "average  difference." 

The  P.  E.  of  a  scale  =  5;J^XAv.  Diff. 

V2 

=  0.5978XAv.  Diff.8 
This  formula  applies  whether  the  two  tests  from  which  the 
average  difference  is  found  are  two  separate  equivalent  tests 
or  two  halves  of  the  same  test.  If  two  separate  forms  of  the 
same  test  had  been  used,  the  above  formula  (P.  E.  =  0.5978X 
Av.  Diff.)  would  give  the  correct  value,  but  in  the  case  of  the 
two  halves  of  the  same  test,  a  further  calculation  must  be  made. 
The  formula  gives  the  P.  E.  of  the  half  tests,  but  what  is  desired 
to  obtain  finally,  is  the  P.  E.  of  the  whole  test — not  the  P.  E. 
of  one  of  its  halves.  The  P.  E.  of  a  test  increases  as  the  square 
root  of  its  length;  that  is,  in  this  case,  the  whole  test  is  twice 
as  long  as  its  halves,  and  its  P.  E.  consequently  increases  by  ^2 . 
The  P.  E.  of  the  whole  test  would,  then,  be  equal  to  that  of  the 

^  Brown,  William.  Essentials  of  mental  measurement.  New  York:  G.  P.  Put- 
nam's Sons,  1911,  p.  101. 

*  Thomdike,  E.  L.  An  introduction  to  the  theory  of  mental  and  social  measure- 
ments.   New  York:  Teachers  College,  Columbia  University,  1916,  pp.  190-93. 
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half  test,  multiplied  by  the  "^2.  The  resulting  formula  for 
deriving  the  P.  E.  of  a  test  from  that  of  its  halves  becomes : 
P.  E.=0.5978XAv.  Diff.X^I^ 
3.  Results. — The  coefficients  of  reliability  for  grades  i  and 
II  and  for  ages  six  and  seven  are  given  in  Table  III.  For  grade  i 
and  age  six,  the  first  column  represents  the  reliability  of  the  scale, 
including  all  zero  scores;  the  second  column  gives  the  reliability 

TABLE  III.  THE  COEFFICIENTS  OF  RELIABILITY  BETWEEN  THE 
THE  TWO  HALVES  OF  THE  PRIMER  SCALE  FOR  GRADES  I  AND  II 
AND  FOR  AGES  SIX  AND  SEVEN,  AFTER  APPLYING  THE  FORMULA: 

l+n 
(In  this  formula  ri  is  the  coefficient  of  correlation  obtained  by 
correlating  the  two  halves  of  the  scale  and  ^2  is  the  co- 
efficient of  reliability  given  in  the  table  below.) 


GRADE  I  (142  cases) 

AGE    SIX    (90   cases) 

Grade  II 
(120 

Cases) 

Zero 

Scores 

Included 

Zero 

Scores 

Omitted 

Zero 

Scores 

Included 

Zero 

Scores 

Omitted 

Age  Seven 

(103 

Cases) 

/ 

2 

3 

4 

5 

6 

Total  score 

Test  I 

0.96 
0.94 
0.92 
0.89 
0.82 

0.95 
0.90 
0.81 
0.81 

0.78 

0.95 
0.92 
0.88 
0.88 
0.84 

0.94 
0.89 
0.81 
0.81 
0.79 

0.89 
0.89 
0.67 
0.93 
0.54 

0.92 
0  84 

Test  II 

0  68 

Test  III 

0  93 

Test  IV 

0  75 

omitting  the  zero  scores.  Neither  method  is  satisfactory.  If 
the  test  were  to  be  given  again,  some  but  probably  not  all,  of 
those  children  making  zero  scores  would  make  a  higher  score. 
Since  some  of  them  would,  the  first  column  of  coefficients,  includ- 
ing all  the  zero  scores,  is  too  high:  but,  since  not  all  of  them 
would,  the  second  column  of  coefficients,  omitting  all  zero  scores, 
is  too  low.  Thus  the  true  coefficient  probably  lies  somewhere 
between  the  two. 

The  coefficients  of  reliability  are  uniformly  high  for  the  whole 
scale  and  for  the  first  and  third  tests,  but  vary  considerably  for 

*  The  writer  is  indebted  to  Dr.  Walter  S.  Monroe  for  this  method  of  detemdning 
the  P.  E.  of  a  scale  from  the  P.  E.  of  its  halves;  as  well  as  for  many  other  helpful  sugges- 
tions and  criticisms  in  the  course  of  the  statistical  analysis. 
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the  second  and  fourth  tests  in  the  different  groups.  The  reliabil- 
ity, as  measured  by  the  correlation  of  one  half  of  a  scale  to  the 
other,  is  in  part  a  measure  of  the  consistency  of  the  performance 
of  the  pupils,  and  in  part  a  measure  of  the  consistency  of  the 
test  from  item  to  item.  It  is  the  judgment  of  the  writer  that  the 
rehability  coefficient  is  mainly  an  index  of  the  latter  factor.  If 
the  halves  of  a  test  correlate  highly,  it  is  evident  that  the  items 
composing  the  two  halves  demand  the  same,  or  approximately  the 
same  kind  of  mental  effort.  For  Tests  I  and  III  this  consistency 
is  high;  these  tests  are  both  "form"  tests,  they  demand  no  informa- 
tion of  any  kind,  and  it  apparently  makes  little  difference  which 
set  of  items  is  used.  Tests  II  and  IV  call  for  information  of  a 
practical  sort;  the  two  halves  of  these  tests  correlate  rather 
poorly — sometimes  very  poorly.  Evidently,  practical  informa- 
tion is  not  at  all  the  unitary  thing  that  form  discrimination  is; 
and  the  kind  of  information  demanded  by  one  item  is  different 
from  that  demanded  by  another.  If  still  another  form  of  the  test 
were  to  be  used,  it  is  probable  that  these  two  tests  would  still 
correlate  poorly,  since  these  new  items  would  involve  still  different 
informational  elements. 

The  P.  E.  of  the  scale  was  derived  in  the  manner  explained 
above.  The  P.  E.  of  grade  i  (142  cases)  was  2.39  "points," 
or  units;  that  of  age  six  (90  cases)  was  2.20  "points,"  or  units 
on  the  scale.  Since  the  difference  between  the  median  of  one 
age  and  the  median  of  the  next  age  is,  on  the  average,  twelve 
"points,"  or  units,  a  P.  E.  of  2.39  points  would  equal  2.39  months, 
and  a  P.  E.  of  2.20  points  would  equal  2.20  months.  Again, 
since  there  are  about  twelve  points  from  one  age  to  the  next, 
a  statement,  for  example,  that  a  given  child  scores  at  the  median 
for  the  age  above  his  own,  does  not  seem  to  be  invalidated  by  the 
unreHability  of  the  scale,  since  the  differences  between  the  suc- 
cessive medians  are  well  beyond  the  P.  E.  of  the  scores. 

The  P.  E.  of  the  Stanford-Binet  Scale  has  been  estimated  by 
Otis  to  be  about  three  and  a  half  months.^"  The  P.  E.  of  the 
Primer  Scale  is  even  less.  If  the  same  reliability  can  be  obtained 
with  a  group  scale  as  with  an  individual  scale,  the  group  scale  can, 

"  Otis,  A.  S.  "An  absolute  point  scale  for  the  group  measurement  of  intelligence," 
Journal  of  Educational  Psychology,  9:341,  June,  1918. 
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to  some  extent,  take  the  place  of  the  individual  scale,  at  least 
for  the  preliminary  sorting  of  pupils. 

On  the  whole,  the  scale  seems  very  reliable — unusually  so  when 
the  ages  of  the  children  are  considered.  Considerable  confidence 
may,  therefore,  be  placed  in  the  accuracy  of  the  scores  obtained. 

IV.    Summary 

1.  The  writer  presents  data  to  show  the  reliability  and  the 
validity  of  the  Primer  Scale. 

2.  The  validity  is  shown  (1)  by  the  distribution  of  scores 
made  on  the  Primer  Scale  by  children  who  have  been  classified 
according  to  I.  Q.  on  the  Binet  examination;  (2)  by  the  correla- 
tions for  various  groups  of  children  between  the  group  scale  and 
the  Binet  ratings;  and  (3)  by  partial  coefficients  of  correlation. 

3.  The  reliability  is  shown  by  (1)  the  coefficients  of  rehability 
for  different  ages  and  grades  and  (2)  by  the  P.  E.  of  the  whole 
scale,  as  derived  from  the  P.  E.  of  the  half  scale. 

4.  It  is  concluded  that  the  Primer  Scale  is  reasonably  valid 
and  reliable. 


THE  APPLICATION  TO  TABLES  OF  DISTRIBUTION  OF  A 

SHORTER  METHOD  FOR  COMPUTING 

COEFFICIENTS  OF  CORRELATION 

Leonard  P.  Ayres 
Russell  Sage  Foundation 

In  the  March  number  of  the  Journal  of  Educational 
Research  there  appeared  an  article  by  the  writer  on  a  shorter 
method  for  computing  the  coefficient  of  correlation.  The  method 
described  avoids  the  necessity  for  finding  the  deviations  of  the 
separate  measures  from  their  averages  and  so  eliminates  the 
necessity  for  watching  for  unlike  signs  and  making  the  series  of 
corrections  to  allow  for  differences  between  the  guessed  averages 
and  the  true  averages  of  the  two  series.  The  present  article 
explains  the  appUcation  of  the  method  to  tables  of  distribution. 

The  new  method  is  based  on  the  principle  that  in  any  series 
of  numbers  the  sum  of  the  squares  of  the  deviations  from  the 
average  is  equal  to  the  sum  of  the  squares  of  the  numbers  in  the 
series,  minus  the  product  of  the  total  of  the  series  and  its  average. 
The  formula  for  this  method  is  as  follows : 

Sum  of  products  of  subject  and  relative  items 

minus 
av.  of  subject  items  X  tot.  of  relative  items 


Sum  of  squares  of  sub.  items  Sum  of  squares  of  rel.  items 

minus  y^  minus 


av.   X  total   of  these  items 


av.  X  total  of  these  items 


In  using  this  method  the  multiplications  are  made  first  and  the 
corrections  are  made  separately.  For  two  simple  series  of  paired 
measures  the  operations  may  be  illustrated  as  follows: 

Sub.  Rel.  Sub.^  Rel?  Sub.  X  Rel. 


2 

3 

4 

9 

6 

3 

2 

9 

4 

6 

4 

4 

16 

16 

16 

7 

4 

49 

16 

28 

9 

7 

81 

49 

63 

Tot. 

25 

20 

159 

94 

119 

Av. 

5 

4 

29S 
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19 


5X20=100 
5X25  =  125 
4X20=  80 
119-100  =  19 
159-125  =  34 
94-  80  =  14 

19 


19 


=0.87 


1/34x14    l/476       21.82 

The  procedure  is  similar  when  the  method  is  applied  to  a  dis- 
tribution table.  To  illustrate  it  the  case  may  be  taken  of  a  sup- 
posititious age  and  grade  table  for  the  elementary  grades  of  a 
school  system  in  which  one  hundred  children  enter  the  first  grade 
each  year  at  the  age  of  six,  are  promoted  by  annual  promotions  of 
80  percent  so  that  eight  in  each  ten  go  forward  and  two  repeat, 
and  none  drop  out  of  school  during  the  elementary  years.  The 
problem  is  to  compute  the  coefficient  of  correlation  between  the 
ages  and  the  grades  of  the  children.  The  work  is  as  shown  in 
the  accompanying  computations.  The  letters  "S"  and  "R" 
stand  for  "subject"  and  "relative." 


s 

Grades 

R 

-Ages 

T 

6 

7 

8 

9 

10 

11 

12 

13 

ST         SST 

1 

100 

20 

4 

1 

125 

125           125 

2 

80 

32 

9 

2 

123 

246          492 

3 

64 

39 

15 

5 

1 

124 

372        1,116 

4 

51 

42 

20 

8 

2 

123 

492        1,968 

5 

41 

42 

24 

11 

118 

590       2,950 

6 

i3 

41 

27 

101 

606       3,636 

7 

26 

39 

65 

455        3,185 

8 

21 

21 

168        1,344 

T 

100 

100 

100 

100 

100 

100 

100 

100 

800 

3,054      14,816 

Av.  of  sub.  items 

RT 
RRT 

SSf 

600 

3,600 

100 

700 

4,900 

180 

800 

6,400 

260 

900 

8,100 

340 

1,000 

10,000 

422 

1,100 

12,100 

503 

1,200 

14,400 

583 

1,300 

16,900 

666 

7,600 
76,400 

3,054 

-^=3.818  Av. 
800 

Av.  of  rel.  items 

R(SSf) 

600 

1,260 

2,080 

3,060 

4,220 

5,533 

6,996 

8,658 

32,407 

800  ='•'  ^" 
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3,054X9.5  =  29,013 
3,054X3.818  =  11,660 
7,600X9.5  =  72,200 

32,407-29,013=3,394 
14,816-11,660  =  3,156 
76,400-72,200=4,200 

3,394  3,394        3,394 

-=0.932 


1/3,156X4,200      l/l3,255,200     3,641 

In  the  illustrative  example  the  columns  headed  "ST"  and 
"SST"  give  the  items  of  the  subject  series  and  the  squares  of 
these  items.  They  are  found  by  the  simple  process  of  multiplying 
the  numbers  in  the  total  column  by  those  in  the  column  headed 
"S"  at  the  extreme  left  of  the  table  and  then  multiplying  these 
new  totals  by  the  "S"  numbers  once  more.  A  similar  process 
gives  the  "RT"  and  "RRT"  rows  at  the  bottom  of  the  table. 

The  next  step  is  to  find  the  products  of  the  paired  values. 
This  is  done  in  the  two  last  rows  at  the  bottom  of  the  table.  The 
first  is  headed  "2Sf"  and  gives  for  each  column  the  sum  of  the 
products  of  the  numbers  in  the  "S"  column  and  their  correspond- 
ing frequencies  in  the  body  of  the  table.  Thus  the  sum  of  the 
products  for  the  second  column  is  180  and  consists  of  1  X  20 
plus  2  X  80. 

After  all  these  sums  of  products  are  found  and  entered  in  the 
row  headed  "2Sf,"  they  are  multiplied  by  the  "R"  numbers  at 
the  heads  of  the  columns  and  the  results  entered  in  the  lowest 
row  headed  R(2:Sf). 

The  averages  are  found  by  dividing  the  total  of  the  subject 
items  (3,054)  by  the  number  of  cases  (800)  which  gives  3.818. 
Similarly  the  sum  of  the  relative  items  (7,600)  is  divided  by  800 
to  give  the  other  average  of  9.5. 

The  next  step  is  to  find  the  three  "total  X  average"  products 
and  to  make  the  three  corrections  which  appear  after  the  table. 
The  first  product  is  that  of  the  total  of  one  series  (3,054)  and  the 
average  of  the  other  (9.5),  or  29,013.  This  is  subtracted  from  the 
sum  of  the  products  of  the  paired  values  (32,407)  giving  the 
remainder  3,394.  This  equals  the  sum  of  the  x  times  y  products 
as  found  in  the  conventional  formula: 

f  =  — rrr: =: 
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Similarly  the  sum  of  the  squares  of  the  items  of  the  subject  series 
(14,816)  is  corrected  by  subtracting  from  it  the  total  of  the  series 
times  its  average.  The  corresponding  operation  is  done  for  the 
relative  series.  The  final  operations  follow  the  formula  given 
at  the  beginning  of  the  article  and  are  the  same  as  those  of  the 
conventional  procedure. 

The  work  is  greatly  facilitated  by  the  use  of  an  adding  machine. 
The  writer  did  all  the  work  of  the  example  given  in  twenty  minutes 
after  the  age-grade  table  had  been  written  down  and  checked  it 
by  repeating  all  the  operations  in  fifteen  minutes.  This  was 
done  with  the  aid  of  a  comptometer — a  small,  non-listing, 
adding  machine  which  can  also  be  used  for  multiplying. 

On  work  such  as  that  given  in  this  article  the  new  method  is 
found  to  be  in  practice  much  faster  than  the  old  one  and  errors 
in  computation  are  very  much  less  likely  to  be  made. 

Erratum 
In  Dr.  Ayres'  first  article  in  the  March  number  of  the  Journal 
OF  Educational  Research  at  page  220,  middle  of  page,  read: 
"Second  correction  =  214 -(6x30)  =214-180=34." 


THE  ACHIEVEMENTS  OF  THE  SCHOOL  YEAR 

As  the  school  year  draws  to  a  close,  do  the  plans  of  superin- 
tendents and  teachers  involve  taking  an  inventory  of  the  achieve- 
ments of  the  year?  The  merchant,  the  manufacturer,  or  the 
banker  (and  we  are  beginning  to  include  the  farmer)  who  does  not 
at  least  once  a  year  take  an  inventory  of  his  business  is  generally 
considered  to  be  headed  toward  certain  failure.  If  when  dealing 
with  such  tangible  things  as  clothing,  drygoods,  machinery,  auto- 
mobiles, corn,  cattle,  and  hogs,  it  is  necessary  to  measure  accurate- 
ly the  results  of  one's  activities  during  the  year,  how  much  more 
is  it  necessary  to  render  an  accounting  when  one  is  dealing  with  the 
less  tangible  achievements  of  the  school  room. 

In  the  records  of  the  school  census,  attendance,  enrollment, 
withdrawals,  and  promotion  the  superintendent  has  at  hand  much 
of  the  crude  data  which  an  inventory  of  his  business  requires. 
Many  superintendents  have  given,  at  times  during  the  year,  one 
or  more  standardized  tests.  The  results  from  these  furnish  addi- 
tional crude  data.  However,  in  order  to  secure  a  satisfactory 
inventory,  there  should  be  an  appraisal  of  the  achievements  of  the 
pupils  during  the  school  year.  The  way  to  do  this  is  to  plan  a 
comprehensive  testing  program  for  use  toward  the  close  of  the 
school  year.  With  the  large  array  of  standardized  tests  now 
available,  the  superintendent  can  secure  the  instruments  needed 
for  measuring  many  of  the  important  achievements  accomplished 
during  the  year. 

The  labor  involved  in  the  preparation  of  an  inventory  of  the 
year's  work  will  perhaps  appall  many  schoolmen.  Some  will 
doubtless  claim  that  they  have  been  successful  in  the  past  without 
rendering  an  account  of  the  year's  work.  In  reply  to  these  it  is 
only  necessary  to  say  that  there  was  a  time  when  many  merchants 
were  successful  who  never  made  an  inventory  of  their  business. 
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But  the  time  has  now  passed  in  the  business  world  when  a  man  can 
expect  to  be  successful  without  it.  If  the  time  has  not  arrived  in 
educational  activities  when  such  a  procedure  is  necessary  for 
success,  the  time  is  rapidly  approaching.  It,  therefore,  behooves 
those  superintendents  who  desire  to  be  rated  among  the  successful 
ones  to  plan  definitely  for  the  rendering  of  an  accounting  of  the 
year's  work. 

W.  S.  M. 

THE  GIFTED  CHILD 

For  years  serious  attention  has  been  given  to  the  handling  of 
backward  and  defective  children.  This  involves  methods  of 
instruction,  curriculum  making,  promotion,  and  segregation. 
Such  efforts  are  worth  while,  and  we  do  not  wish  to  minimize  their 
importance.  We  do  wish,  however,  to  insist  that  we  must  give 
more  attention  than  has  heretofore  been  given  to  the  education 
of  children  of  superior  mental  ability. 

Superior  children  who  are  merely  carried  along  through  the 
grades  under  the  customary  "time  service"  spend  many  days  of 
their  school  life  during  which  their  minds  are  being  injured  rather 
than  educated.  Many  a  boy,  instead  of  letting  his  brain  power  run 
idle  in  the  classroom  while  slower  minds  labor  to  understand  prob- 
lems that  present  no  difl&culty  to  him,  would  be  better  off  playing 
in  the  field.  Ought  a  bright  child  be  penalized  because  he  is 
bright?  We  speak  of  equal  rights;  but  equal  rights  involve 
equal  opportunities.  And  such  children  are  robbed  of  their  oppor- 
tunity for  self-realization. 

Conservation  of  power  and  reduction  of  waste  is  an  important 
social  ideal.  A  lot  of  the  brain  power  in  our  schools  is  daily  going 
to  waste  because  it  is  idling  far  below  its  normal  working  capacity. 
Genius  which  spends  itself  on  inferior  work  is  wasted.  Our 
educational  practice  needs  a  severe  earthquake  that  will  shake 
us  loose  to  the  recognition  of  this  waste. 

Recently  we  have  heard  more  about  "doing  something  for 
superior  children,"  but  actual  efforts  to  discover  such  children 
have  been  comparatively  few  and  spasmodic.  With  the  present 
development  of  mental  testing  we  have  an  effective  tool  by  which 
teachers  and  school  administrators  may  make  systematic  search 
for  these  children.    If  such  an  instrument  is  not  used,  each  gifted 
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child  must  force  himself  upon  the  attention  of  someone  who  has 
backbone  enough  to  break  away  from  tradition.  Classroom 
procedure  is  not  organized  so  as  to  favor  a  child's  forcing  himself 
into  recognition.  Moreover,  in  many  places  even  if  superior 
ability  is  perfectly  evident,  nothing  short  of  a  miracle  will  cause 
the  traditional  system  to  break  its  regularity  of  habit. 

The  latest  development  in  mental  testing  is  the  group  test. 
It  can  be  given  to  hundreds  of  children  in  a  single  day.  It  affords 
impersonal  data  from  which  to  estimate  a  child's  capacity,  and  it 
thus  removes  the  decision  from  the  field  where  the  personal 
feelings  of  teachers  or  of  fond  parents  play  a  part.  Experience 
proves  that  these  group  tests,  in  spite  of  the  ease  with  which  they 
may  be  administered,  have  a  high  degree  of  reliability.  The 
results  can  be  used  for  "spotting"  individuals;  and  wherever 
there  are  serious  differences  between  test  results  and  other  data, 
the  child  may  be  given  further  study  or  additional  tests.  These 
group  tests  ought  to  come  into  immediate  and  extensive  use  for  the 
discovery  of  superior  mental  capacity  in  all  classes  from  grade 
three  up.  Indeed,  some  group  tests  promise  to  be  fairly  reliable 
even  below  the  third  grade.  Individual  mental  tests  should  be 
used  on  all  school  children  who  are  too  young  to  be  tested  by 
means  of  a  group  test. 

No  superintendent  or  principal  should  be  satisfied  with  any- 
thing less  than  a  complete  and  systematic  search  of  his  school  for 
superior  ability.  Having  found  such  abiHty,  he  should  devise 
ways  and  means  to  handle  the  administrative  problems  of  educa- 
tion so  that  this  abihty  may  be  put  to  work.  This  is  not  altogether 
easy.  It  means  that  more  thinking  and  more  effort  must  be  put 
into  both  administration  and  teaching.  The  problem  can  be 
solved,  and  it  is  being  solved  in  many  places.  Various  plans  are 
being  used  but  none  of  them  is  as  important  as  the  clear  realiza- 
tion that  superior  mental  capacity  should  be  used  and  trained 
instead  of  being  allowed  to  waste  away  in  the  formation  of  habits 
of  idleness  and  mischief. 

With  such  a  realization,  intelligence  properly  applied  will 
meet  the  problem.  Whether  we  like  the  work  or  not,  it  must  be 
done.  Let  us  face  the  task  squarely.  With  due  apology  to 
advertising,  we  may  say  "do  it  now,  for  eventually  you  must." 

Virgil  E.  Dickson 


Courtis,  Stuart  A.     The  Gary  public  schools:  measurement  of  classroom 
products.    New  York:  General  Education  Board,  1919.     532  pp. 

This  is  the  last  volume  of  the  report  of  the  survey  of  the  Gary  public 
schools  and  is  based  upon  results  of  a  number  of  educational  tests  given  to 
the  pupils  in  the  Froebel,  Emerson,  Jefferson,  and  Beveridge  schools  between 
April  11  and  June  9,  1916.  The  testing  program  was  introduced  by  a  series 
of  nine  simple  psychological  tests  the  scores  from  which  are  not  included  in 
the  report.  The  purpose  of  giving  these  introductory  tests  was  to  familiarize 
the  pupils  with  the  procedure  of  testing.  Each  test  was  given  throughout 
the  four  buildings  on  the  same  day  except  for  occasional  classes  which  were 
tested  on  the  following  day.  Unusual  care  was  taken  to  control  the  condi- 
tions of  testing.  Mr.  Courtis  and  three  trained  assistants  gave  practically 
all  of  the  tests.  Automatic  timers  were  used  when  feasible.  The  test  papers 
were  scored  in  duplicate.  These  precautions  give  the  resulting  scores  a 
higher  degree  of  reliability  than  they  would  have  under  ordinary  conditions. 
The  tests  and  the  grades  to  which  they  were  given  were  as  follows: 
I.     Spelling. 

Cleveland  List  Tests,  grades  two  to  twelve 
Courtis  Dictation  Spelling  Tests,  grades  two  to  twelve 
Spelling  was  also  tested  by  means  of  the  Denver  Composition 
Test,  grades  four  to  twelve 
II.     Handwriting.     The  quality  of  the  following  types  of  material  was 
measured  by   the  Ayres'  Handwriting  Scale,   "three  slant 
edition." 
Free  Choice  Handwriting  Test,  grades  three  to  twelve 
Denver  Composition  Test,  grades  four  to  twelve 

III.  Arithmetic 

Courtis  Standard  Research  Tests,  Series  B,  Forms  3  and  4,  grades 

four  to  twelve 
Cleveland  Survey  Arithmetic  Tests,  Sets  C,  G,  H,  L,  and  O, 

grades  three  to  twelve 

IV.  Reading 

Kansas  Silent  Reading  Test  I,  grades  three  to  twelve 
Kansas  Silent  Reading  Test  II,  grades  four  to  eight 
Kansas  Silent  Reading  Test  III,  grades  eight  to  twelve 
Gray's  Oral  Reading  Test,  grades  three  to  eight 
Reproduction  Tests,  grades  two  to  twelve 
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Trabue  Language  Scales,  B,  C,  D,  and  E,  grades  four  to  twelve 
V.    Language 

Denver  Composition  Test,  grades  four  to  twelve 

This  volume  stands  out  as  distinctive  in  the  series  of  volumes  which 
make  up  the  report  of  the  survey  of  the  Gary  public  schools.  In  the  first 
place,  it  contains  532  pages  besides  the  introduction  and  author's  preface. 
The  next  largest,  which  is  the  summary  volume,  has  only  265  pages.  Second, 
it  comes  from  the  press  several  months  after  the  others  have  been  in  the 
hands  of  readers  and  more  than  three  years  after  the  giving  of  the  tests  in 
Gary  was  completed.  Third,  the  volume  is  a  combination  of  the  report  of 
the  survey  and  a  treatise  on  the  theory  of  educational  measurements. 

Besides  a  chapter  given  to  each  of  the  school  subjects  for  which  tests 
were  given  there  are  four  other  chapters:  Chapter  1,  "General  Statement," 
in  which  is  included  a  brief  discussion  of  the  status  and  limitations  of  edu- 
cational measurements;  Chapter  2,  "Tests  and  Testing  Conditions;"  Chapter 
8,  "Factors  Affecting  Performance;"  Chapter  9,  "Conclusions."  There  is 
an  effort  to  make  the  report  as  readable  as  possible.  The  presentation  for 
each  school  subject  is  divided  into  three  parts.  First,  there  is  a  concise 
non-technical  discussion  of  the  significant  aspects  of  the  data  secured. 
Second,  there  is  a  discussion  of  "all  that  is  involved  in  the  testing  process." 
Third,  in  the  appendices  of  the  volume  there  is  reproduced  a  number  of  the 
tabulations  and  a  quantity  of  other  data  in  which  students  of  education  will 
be  interested.  This  organization  materially  facilitates  the  reading  of  the 
report  for  one  who  is  not  interested  in  critical  discussions  of  the  tests.  One 
is  disappointed,  however,  in  not  finding  a  concise  summary  statement  of  the 
findings  for  each  subject.  A  partial  exception  to  this  statement  should  be 
made  in  the  case  of  handwriting.  A  judicious  use  of  paragraph  headings 
would  materially  increase  the  clarity  of  the  report. 

The  volume  must  be  judged  both  as  a  report  of  the  Gary  survey  and 
as  a  treatise  on  educational  measurements.  The  conception  of  the  survey 
is  shown  to  have  been  comprehensive  and  the  precautions  exercised  in  its 
execution  may  well  be  taken  as  a  model  for  future  surveys.  For  example, 
several  tests  were  used  in  each  school  subject.  This  is  good  procedure, 
because  no  single  test  can  possibly  have  the  same  reliability  that  a  battery 
of  several  tests  has.  Furthermore,  no  one  test  can  cover  the  entire  field  of 
a  school  subject.  Again,  the  scoring  was  done  in  duplicate  by  pupils  and 
checked  by  examiners.  This  also  contributes  to  the  reliability  of  the  pub- 
lished results.  Among  a  number  of  other  instances  of  the  precautions  taken, 
one  may  mention  the  fact  that  the  judges  who  rated  the  compositions  were 
carefully  trained  to  their  work  before  they  began  scoring. 

In  general  the  interpretation  of  the  scores  is  made  with  unusual  care 
and  fairness.  In  English  composition,  for  example,  pupils  wrote  on  the 
same  subject  and  under  the  same  conditions  as  obtained  in  the  surveys  of 
Denver  and  Grand  Rapids.  The  compositions  from  these  latter  cities 
were,  however,  measured  by  the  WilHng  Scale.  In  order  to  secure  compara- 
tive data  by  which  to  interpret  the  Gary  results  it  was  obviously  necessary 
to  have  the  Gary  papers  rated  on  the  same  scale.     The  added  precaution 
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was  taken  of  having  them  (those  of  the  eighth  grade)  rated  by  the  same 
person — namely  Mr.  Willing — who  rated  the  papers  at  Denver  and  at  Grand 
Rapids.  Many  other  instances  might  be  given  of  the  unusual  care  and  fair- 
ness with  which  interpretations  were  made.  Indeed,  the  author  shows  a 
disposition  to  set  up  and  dispose  of  as  many  possible  objections  as  he  can. 
He  seems  to  assume — with  some  truth  we  admit — that  his  conclusions  will 
be  assailed.  His  state  of  mind  in  this  matter  might  be  described  as  "ner- 
vous." 

The  author  states  as  a  general  conclusion,  "that  the  product  of  the 
class  room  teaching  of  the  fundamentals  is,  at  Gary,  poor  in  quality  and 
inadequate  in  amount;  it  approximates  in  character  the  product  of  the  poorer 
conventional  schools,  and  reveals  in  no  particular  the  slightest  indication 
that  it  has  been  affected  either  favorably  or  unfavorably  by  the  enriched 

curriculum  or  other  special  features  of  the  Gary  schools The  entire 

investigation  reveals  many  and  consistent  evidences  of  careless  work,  imper- 
fectly developed  habits  and  marked  lack  of  achievement."  (p.  384)  A  care- 
ful study  of  the  results  of  the  tests  reveals  many  instances  which  confirm  the 
above  statement.  In  many  cases  the  Gary  scores  are  below  comparative 
data  from  conventional  schools.  In  some  cases,  however,  the  Gary  scores 
compare  favorably  with  the  "available  standards"  and  in  a  few  cases  com- 
parative data  are  not  used  which  wovdd  result  in  a  more  favorable  though 
not  necessarily  reversed  conclusion  in  respect  to  Gary. 

For  example,  in  interpreting  the  handwriting  scores  for  quality  compara- 
tive scores  from  Iowa,  Cleveland,  St.  Louis,  Grand  Rapids,  and  Kansas  City 
and  the  standards  proposed  by  Freeman  and  Starch  are  used.  It  is  entirely 
possible  that  the  average  performances  of  the  pupils  in  conventional  schools 
are  too  high  for  satisfactory  standards.  No  reference  is  made  to  the  studies 
by  Ashbaugh^  and  Koos^  in  which  they  indicate  that  possibly  the  standards 
for  quality  should  be  lower  than  Freeman  and  some  other  investigators  have 
indicated.  Ashbaugh  shows  that  the  New  York  Civil  Service  Commission 
accepts  40  and  50  for  "passing"  in  writing;  and  Koos  proposes  an  ultimate 
standard  of  60,  even  finding"  considerable  justification"  for  50.  The  eighth- 
grade  median  for  Gary  was  43. 

The  conclusion  is  reached  that  "handwriting  instruction  at  Gary  is 
producing  very  small  effect  upon  the  product."  (p.  46)  This  gives  one  the 
impression  that  the  handwriting  is  entirely  unsatisfactory.  While  it  is  true 
that  quality  at  Gary  is  below  even  the  lowest  proposed  standard,  it  is  equally 
true  that  rate  is  notably  above  the  rates  used  as  comparative  data.  Rate 
of  writing  is  important  and  credit  should  be  given  for  this  phase  of  the 
product  of  instruction  in  handwriting.  Indeed,  the  author  does  so  in  other 
connections.  It  may  be  noted  in  passing  that  this  is  not  the  only  instance 
in  the  report  of  inconsistency  of  statement. 

1  Ashbaugh,  E.  J.  Handwriting  of  Iowa  scliool  children.  (Bulletin  of  State  University  of  Iowa, 
March,  1916.) 

>  Koos,  L.  V.  "The  determination  of  ultimate  standards  of  quality  in  handwriting  for  the  public 
schools,"  Elementary  School  Journal,  18:423,  February,  1918. 
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Another  example  may  be  cited  from  the  chapter  on  English  composition. 
In  addition  to  judging  compositions  by  means  of  the  Hillegas  Scale,  a  study 
was  made  of  the  vocabulary  used  by  the  eighth-grade  children  at  Gary. 
Comparison  is  made  with  the  vocabularies  reported  by  Jones  and  the  con- 
clusion is  reached  that  "a  careful  study  of  the  vocabulary  fails  to  show  any 
clear  effect  of  special  training  at  Gary."  In  the  discussion  there  is  no  recog- 
nition of  the  possible  effect  of  the  foreign  population  of  Gary  upon  the  vocabu- 
lary of  the  children.  This  factor  may  have  been  taken  into  consideration 
but  there  is  no  direct  evidence  of  it.  Neither  does  he  consider  the  possible 
effect  of  the  fact  that  each  child  at  Gary  wrote  but  one  composition — and 
that  on  "an  exciting  experience" — while  the  children  in  Jones'  study  wrote 
on  the  average  105  compositions  each  and  were  judged  to  have  exhausted 
their  vocabularies. 

A  third  example  of  conclusions  at  variance  with  the  sweeping  general 
statement  quoted  above  may  be  taken  from  the  chapter  on  reading.  The 
Kansas  Silent  Reading  Tests  yielded  median  scores  at  Gary  which  approxi- 
mate the  standard  for  conventional  schools  from  the  sixth  grade  to  the  eighth 
grade  inclusive  and  which  are  rather  notably  above  standard  for  grades 
nine,  ten,  and  eleven.  It  is  only  in  grades  three  and  four  that  the  Gary 
scores  are  materially  below  standard.  It  is  true  that  these  facts  are  stated  by 
the  author  in  their  appropriate  places.  The  point,  however,  is  that  they 
are  not  reflected  in  his  general  conclusions. 

In  the  summary  volume  the  following  paragraph  appears.  "The 
impressions  gained  through  inspection  and  the  results  of  the  tests  are  not 
entirely  consistent.  For  example,  silent  reading  makes  a  distinctly  better 
showing  in  the  tests  than  one  would  have  expected  on  the  basis  of  class  room 
observation.  Spelling  makes  a  poor  showing  on  the  list  test  and  a  very  good 
showing  on  the  composition  test.  It  is  not  possible  to  reconcile  these  diver- 
gencies without  adducing  considerations  as  to  which  different  opinions  could 
fairly  be  entertained.  Without,  however,  seeking  to  ignore  the  conflict  of 
evidence,  the  authors  still  feel  that  the  quality  of  class  room  instruction  at 
Gary  falls  short  of  what  is  necessary."  (p.  102) 

After  studying  the  survey  report  on  "Measurement  of  Classroom  Pro- 
ducts" and  finding  the  interpretation  of  results  open  to  such  criticisms  as 
indicated  above,  one  cannot  help  feeling  that  at  times  the  author  has  allowed 
his  interpretations  to  be  colored  by  what  the  writers  of  the  summary  volume 
suggest  to  have  been  the  prevailing  opinion  of  the  survey  staff.  Even  if 
such  instances  are  not  numerous  in  the  report,  it  is  unfortunate  that  they 
exist  at  all,  because  the  objective  nature  of  standardized  tests  has  probably 
been  the  most  convincing  argument  in  favor  of  their  use.  If  the  measure- 
ment is  objective  but  the  interpretation  becomes  subjective,  this  argument 
loses  its  force. 

As  a  treatise  on  the  theory  of  educational  measurements,  the  volume 
is  a  notable  contribution.  It  contains  a  discussion  of  the  nature  of  the 
abilities  and  detailed  descriptions  and  analyses  of  certain  of  the  tests  used. 
Mr.  Courtis  gives  for  the  first  time  an  account  of  the  construction  of  the 
Courtis  Standard  Research  Tests  in  Arithmetic,  Series  B.    A  more  complete 
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account  is  given  of  the  validity  and  reliability  of  most  of  the  tests  used  than 
has  heretofore  been  published. 

In  Chapter  VIII  the  author  considers  the  factors  upon  which  perfor- 
mance depends.  This  constitutes  an  important  analysis,  and  throws  an 
unexpected  light  on  the  meaning  which  may  be  attached  to  the  Gary  scores 
in  different  tests.  The  basic  factor  upon  which  performance  depends  is 
heredity  or  "capacity."  The  maturity  of  the  pupil  is  a  second  important 
factor.  Maturity  together  with  general  training  (a  third  factor)  is  shown 
to  be  more  potent  in  the  Gary  schools  than  specialized  training  (a  fourth 
factor)  in  the  development  of  the  following  abilities:  rate  of  copying  figures, 
oral  reading,  writing  of  multiplication  combinations,  handwriting  (all  tests), 
addition  in  Series  B,  and  rate  of  silent  reading  as  revealed  by  the  Kansas 
Silent  Reading  Test.  On  the  other  hand,  specialized  training  is  more  potent 
in  engendering  accuracy  of  performance — e.g.,  in  silent  reading,  long  division, 
addition  and  subtraction  of  simple  fractions.  This  distinction  is  fundamen- 
tal in  judging  the  efficiency  of  specialized  instruction  on  the  basis  of  scores 
yielded  by  standardized  tests — and  it  is  a  distinction  which  Mr.  Courtis  has 
more  ably  presented  than  any  other  survey  writer. 

Students  interested  in  the  theory  of  educational  measurements  will  find 
the  report  a  source  of  much  valuable  information.  The  various  "critical 
discussions"  of  the  tests,  however,  which  are  announced  to  contain  "all  that 
is  involved  in  the  testing  process,"  fall  disappointingly  short  of  the  realization 
of  this  ambitious  announcement.  For  example,  in  the  critical  discussion  of 
spelling,  the  author  points  out  that  the  ability  to  spell  is  "specific"  (although 
it  may  contain  a  general  factor),  and  that  from  a  child's  abiUty  to  spell  one 
word  no  reliable  inference  can  be  made  concerning  his  ability  to  spell  any 
other  word.  However,  a  pupil's  spelling  of  a  number  of  words  can  be  used 
as  a  basis  for  infering  his  ability  to  spell  other  words  belonging  to  the  same 
difficulty  group.  The  reliability  of  the  inference  is  greater  when  random 
samples  are  used  and  increases  with  the  number  of  words.  Unfortunately, 
the  discussion  does  not  deal  with  the  relation  between  the  reliability  of  the  in- 
ference and  the  number  of  words  used,  except  to  say,  "it  seems  to  the  writer 
probable  that  the  conclusions  would  not  be  changed  were  the  number  of 
test  words  to  be  largely  increased." 

Neither  does  the  author  investigate  the  relation  between  the  reliability 
of  a  test  and  the  difficulty  of  the  words  used,  or  the  relation  between  the 
reliability  of  a  test  and  the  method  of  giving  the  test  words.  These  omissions 
occur  in  spite  of  the  author's  statement  that  "the  preceding  discussions 
have  had  for  their  purpose  the  full  statement  in  regard  to  the  validity  of 
the  performance  of  an  individual  in  a  single  test  as  a  measure  of  his  ability 
in  spelling." 

The  discussions  for  the  other  subjects  have  similar  limitations.  At  the 
present  stage  of  the  development  of  measuring  instruments  and  the  analysis 
of  the  measuring  process,  it  is  not  to  be  expected  that  the  "critical  discus- 
sions" would  be  complete.  In  fact,  they  contain  much  more  than  one  might 
expect,  since  they  are  somewhat  incidental  to  a  survey  report.  The  pro- 
priety of  attempting  to  include  in  such  a  report  a  discussion  of  "all  that  is 
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involved  in  the  testing  process"  will  doubtless  be  questioned  by  many  readers. 
One  finds  many  pages  that  appear  to  contribute  very  little  to  a  report  of  the 
"measurement  of  class  room  products,"  although  undoubtedly  they  will  be 
commended  by  those  who  are  interested  in  the  theory  of  educational  measure- 
ments and  would  very  properly  find  place  in  a  treatment  of  that  topic. 
The  inclusion  of  these  topics  undoubtedly  delayed  the  preparation  of  the 
report,  and  in  this  way  lessened  the  value  of  the  volume  as  a  report  of  the 
survey. 

In  the  dual  character  of  the  report,  there  is  evidence  that  as  yet  we  have 
not  found  a  satisfactory  procedure  for  reporting  the  use  of  educational 
tests  in  a  school  survey.  If  the  author  gives  no  more  than  the  results  and 
his  interpretation  of  them,  he  may  be  accused  of  misinterpretation  and  even 
misrepresentation  by  some  of  those  who  do  not  understand  the  process  of 
measurement  and  the  limitations  of  the  particular  tests  used.  On  the 
other  hand,  if,  as  in  this  case,  the  author  enters  into  a  critical  discussion  of 
the  tests  and  the  theory  of  measurement,  the  report  may  lack  unity  and  will 
certainly  become  voluminous.  It  may  fail  to  be  effective  in  making  clear 
the  actual  conditions  which  were  found  to  exist.  Presumably  Mr.  Courtis 
was  interested  in  the  opportunities  that  the  survey  afforded  for  research. 
At  any  rate,  it  is  certain  that  as  a  contribution  to  the  literature  of  educa- 
tional research  his  book  is  a  more  notable  contribution  than  it  is  as  a  report 
of  the  measurement  of  classroom  products  at  Gary. 

W.  S.  M. 

BucKNER,  Chester  A.   Educational  diagnosis  of  individual  pupils  (Teachers 

College,   Contributions  to  Education,  No.  98).  New  York:  Teachers' 

College,  Columbia  University,  1919.    93  pp. 
Fretwell,  Elbert  K.    A  study  in  educational  prognosis  (Teachers  College, 

Contributions  to  Education,  No.  99).   New  York:  Teachers'  College, 

Columbia  University,  1919.    55  pp. 

These  are  companion  volumes  in  the  sense  that  the  investigations  which 
they  report  were  carried  out  upon  the  basis  of  the  same  tests  of  the  same  boys. 

Dr.  Buckner  investigates  the  methods  by  which  scores  in  one  test  may 
be  legitimately  compared  with  scores  in  another,  the  amount  and  distribution 
of  individual  variability,  the  existence  of  erratic  scores,  the  causes  of  extreme- 
ly variant  scores,  and  the  relation  between  ability  and  variation.  To  express 
these  scores  in  terms  of  the  standard  deviation  or  the  quartile  deviation  per- 
mits comparison  between  them,  and  at  the  same  time  retains  the  refinement 
of  the  original  scores. 

As  usual  it  was  found  that  pupils  varied  widely  in  a  given  test,  extreme 
scores  being  more  numerous  below  the  median  than  above  it.  It  was  also 
found  that  a  given  pupil  differed  markedly  in  his  scores  on  different  tests, 
the  scores  having  first  been  made  comparable.  It  appears  that  the  more 
capable  pupils — if  we  may  draw  practical  conclusions  from  theoretical  dis- 
cussions— not  only  do  better  work  but  that  they  do  it  more  consistently. 

It  is  pointed  out,  moreover,  that  while  some  of  the  variability  and  some 
of  the  extreme  scores  are  caused  by  distractions  and  other  chance  occurrences, 
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these  factors  are  not  as  effective  in  producing  high  scores  as  in  producing  low 
scores.  The  practical  meaning  of  this  would  seem  to  be  that  pupils  who 
obtain  extremely  low  scores  are  entitled  to  the  benefit  of  further  investigation. 

It  seems,  therefore,  to  be  clear  that  the  determination  of  the  status  of  a 
pupil  must  be  carried  out  on  the  basis  of  a  considerable  amount  of  informa- 
tion concerning  each  pupil.  This  is  the  reason  for  teams  or  "batteries"  of 
tests. 

As  to  "Causes  of  Extreme  Variability,"  the  following  are  considered: 
(a)  the  nature  of  the  tests;  (b)  their  administration;  (c)  accidental  occur- 
ences; (d)  statistical  treatment  of  the  results;  and  (e)  the  ability  of  the 
pupil  in  different  traits. 

Two  important  practical  considerations  as  to  the  nature  of  tests  are  dis- 
tinguished. First,  the  range  of  a  test  must  be  somewhat  greater  than  the 
range  of  ability  in  the  group  tested.  Second,  the  intervals  between  possible 
scores  on  the  test  must  be  small. 

We  shall  not  take  up  each  of  these  five  causes.  Naturally  it  is  the 
ability  of  the  pupil  which  most  affects  extreme  variability.  One  of  the 
practical  conclusions  reached  in  this  connection  is  that  extreme  scores  are 
little,  if  any,  more  unreliable  than  those  near  the  median.  This  appears  to 
be  particularly  applicable  to  low  scores  despite  the  fact  that  accidental 
occurences  tend  to  depress  rather  than  raise  results.  The  evidence  on  this 
is  the  fact  that  ability  and  variability  bear  a  direct  relation  to  each  other. 

Dr.  Fretwell  takes  up  the  investigation  at  the  point  where  Dr.  Buckner 
leaves  it.  He  asks:  "Can  academic  success  be  predicted?  If  so,  how?"  The 
conclusion  is  reached  that  academic  success  can  be  predicted.  When  aU 
temporary  illnesses,  ranging  from  bad  colds  through  contagious  diseases  to  a 
month  in  the  hospital,  all  fortunes  or  misfortunes  in  the  home  life,  barring 
withdrawal  from  school,  all  the  change  in  physical  conditions  and  varying 
interests  among  boys  of  eleven  to  thirteen — when  all  these  and  a  score  of 
others  that  might  be  enumerated  are  considered — the  use  of  these  tests  in  one 
and  one  quarter  hours'  testing  at  the  beginning  of  the  year  would  have  agreed 
with  the  classification  of  the  teacher  after  teaching  the  pupils  one  year  in 
90  percent  of  all  the  cases. 

As  to  the  best  basis  of  prediction,  three  others  besides  the  tests  are  con- 
sidered— school  marks  from  the  beginning  of  each  pupil's  school  career,  age, 
and  the  combined  estimates  of  departmental  teachers.  The  results  of  these 
comparisons  lead  the  author  to  say:  "In  this  study,  academic  success  in  the 
first  year  of  junior  high  school  was  more  successfully  predicted  by  a  group  of 
standardized  tests  than  by  all  previous  school  marks  or  age  or  teachers' 
estimates." 

Some  tests  prove  more  valuable  for  prediction  than  others.  The  follow- 
ing is  the  order  of  importance  as  the  author  found  it:  reading  (Thorndike's 
Understandingof  Sentences),  visual  vocabulary,  opposites,  spelling,  comple- 
tion tests,  arithmetic  tests  (Woody),  easy  directions,  mixed  relations,  and 
composition. 

B.  R.  B. 
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Wilson,  Guy  Mitchell.  A  survey  of  the  social  and  business  usage  of  arith- 
metic. (Teachers  College.  Contributions  to  Education,  No.  100). 
New  York:  Teachers  College,  Columbia  University,  1919.     62pp, 

The  ontent  of  school  subjects  is  largely  determined  by  tradition.  This 
simply  means  that  the  content  as  originally  determined  tends  to  be  retained. 
Changes  are  made  from  time  to  time  but  in  general  they  lag  far  behind  social 
and  school  needs.  Recently  the  attention  of  educators  has  been  directed  to 
curriculum  making,  and  many  investigations  have  been  undertaken  to  deter- 
mine what  should  constitute  the  curriculum  in  a  number  of  school  subjects. 

Tradition  has  influenced  to  a  very  large  degree  the  curriculum  of  arithme- 
tic as  it  is  now  taught.  Since  the  work  of  Rice  in  1893  and  McMurry's 
proposals  enunciated  in  1904,  a  number  of  investigators  have  attacked  the 
problem  of  determining  what  the  course  of  study  in  arithmetic  should  be. 
Professor  Wilson  has  employed  a  procedure  which  is  different  from  that  used 
by  preceding  investigators. 

He  states  that  the  "problem  set  for  solution  in  this  study  is  to  determine 
the  arithmetic  actually  used  by  adults  in  their  social  and  business  relations." 
Accordingly  pupils  in  the  sixth,  seventh,  and  eighth  grades  in  23  cities, 
and  in  certain  rural  schools  were  requested  to  secure  from  their  parents 
the  arithmetical  problems  which  the  latter  had  solved  during  a  period  of  two 
weeks.  Reports  were  obtained  from  4,068  persons  and  the  total  number  of 
problems  after  unsatisfactory  reports  were  rejected  was  14,583.  The  author 
demonstrates  that  the  group  of  persons  reporting  is  probably  sufficiently 
representative  of  the  population  of  the  entire  country  with  the  exception  of 
communities  which  have  specialized  activities. 

The  14,583  problems  were  analyzed  as  to  the  topics  involved  and  the 
magnitude  of  the  numbers  occurring  in  the  four  fundamental  operations. 
For  both  integers  and  fractions,  common  and  decimal,  the  author  found  that 
six  topics  (namely,  multiplication,  addition,  subtraction,  division,  fractions, 
and  accounts)  include  sUghtly  more  than  90  percent  of  all  the  problems. 
The  remaining  10  percent  are  divided  among  37  additional  topics. 

With  reference  to  the  magnitude  of  the  numbers,  the  author  found  that 
they  rarely  exceeded  four  places  and  that  the  majority  of  them  did  not  extend 
beyond  two  places.  He  found  only  50  different  common  fractions  in  all  of 
the  problems  reported,  and  40  of  these  occurred  eight  times  or  less. 

Although  the  title  and  the  explicit  statement  of  the  author's  problem 
indicate  that  the  study  was  made  to  determine  what  arithmetic  is  actually 
used  by  adults  in  their  social  and  business  relations,  it  appears  from  a  reading 
of  the  monograph  that  the  author's  real  purpose  was  to  determine  in  a  general 
way  what  should  constitute  the  curriculum  in  arithmetic  in  the  elementary 
school.  In  making  this  application  of  his  results,  he  announces  two  main 
assumptions: 

"(1)  Aim  of  Arithmetic  in  the  Grades.  While  not  denying  the  cultural 
and  disciplinary  value  of  arithmetic — in  common  with  any  subject  systema- 
tically studied  and  well  taught — it  is  assumed  that  arithmetic  in  the  grades 
is  justified  only  on  the  basis  of  its  utility  in  the  common  affairs  of  life.  We 
learn  the  multiplication  table  not  to  sharpen  the  wits  nor  to  comprehend  a 
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beautiful  system  but  to  figure  our  bills,  our  taxes,  or  the  interest  on  a  note. 
Whatever  arithmetic  is  given  in  the  grades  beyond  the  essentials  required  by 
social  utility  consumes  time  that  could  be  used  more  profitably  in  other  ways. 

"(2)  Determining  the  Social  Utility  of  Arithmetic.  Social  utility  can  be 
determined  only  on  the  basis  of  the  uses  of  arithmetic  in  adult  activities." 

Professor  Wilson  would  eliminate  decimal  fractions  except  in  United 
States  money,  proportion  which  he  states  is  really  absent,  square  root,  reduc- 
tions in  denominate  numbers,  exchange,  and  the  metric  system  in  addition 
to  eighteen  other  topics.  He  believes  it  to  be  safe  and  conservative  to  recom- 
mend the  omission  of  these  topics.  He  says,  "If  to  the  four  fundamentals 
and  fractions,  one  were  to  add  accounts,  simple  denominate  numbers,  and 
percentage,  little  would  be  left  for  all  the  other  processes.  So  little,  in  fact, 
that  it  seems  unfair  to  give  attention  to  them  as  drill  processes  in  the  elemen- 
tary schools.    Some  of  them  should  receive  no  attention. 

It  appears  that  the  author  defines  the  use  of  arithmetic  as  "figuring"  and 
that  three  additional  assumptions  are  implied:  (1)  that  adults  are  now 
making  the  uses  of  arithmetic  which  they  should  make  in  their  social  and 
business  activities;  (2)  that  the  needs  for  "figuring"  will  be  approximately 
the  same  in  the  future  as  they  are  now  for  the  adults  included  in  this  study; 
(3)  that  the  best  way  to  prepare  a  child  for  "figuring"  is  to  use  a  curriculum 
based  solely  upon  the  problems  which  adults  use. 

The  author  does  not  consider  the  school  needs  which  a  pupil  may  have  for 
arithmetic  in  the  study  of  geography,  history,  science,  manual  training,  and 
other  school  subjects.  Until  the  curriculums  for  these  subjects  are  changed 
radically,  pupils  will  have  need  for  certain  aspects  of  arithmetic.  In  the 
absence  of  a  scientific  analysis  of  their  arithmetical  requirements,  one  should 
not  assume  that  they  are  included  in  the  adult  social  and  business  usages  of 
arithmetic. 

Doubtless  many  readers  will  be  unable  to  agree  with  Professor  Wilson 
in  his  assumption  that  no  arithmetic  should  be  taught  in  the  elementary 
school  beyond  the  "essentials  required  by  social  utility"  and  that  "social  util- 
ity can  be  determined  only  on  the  basis  of  the  uses  of  arithmetic  in  adult 
activities."  Doubtless  most  readers  will  be  willing  to  accept  this  as  one  of  the 
important  bases;  but  absolutely  to  reject  other  bases — as  the  author  does — 
is  to  take  a  radical  position.  This  is  especially  true  since  he  implicitly  makes 
other  assumptions,  as  has  been  pointed  out,  which  deserve  consideration  in 
the  making  of  a  course  of  study. 

To  define  the  usable  product  of  arithmetical  instruction  as  "figuring"  is 
to  limit  decidedly  the  significance  of  the  subject.  It  is  true  that  "figuring" 
is  the  most  tangible  and  conspicuous  outcome;  but  other  outcomes,  although 
they  are  more  subtle,  are  nevertheless  important  and  should  be  definitely 
planned  for  in  the  making  of  a  curriculum.  Furthermore,  it  is  not  safe  to 
build  a  curriculum  on  the  assumption  that  adults  are  now  making  all  the  use 
of  arithmetic  which  they  should  make  in  their  social  and  business  activities. 
There  seems  to  be  considerable  unanimity  of  opinion  that  in  many  respects 
adults  are  now  lacking  in  efficiency  with  respect  to  quantitative  matters.  As 
an  instance  of  this  we  may  cite  the  agitation  for  family  budgets  and  farm 
accounting. 
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Professor  Wilson's  study  will  no  doubt  have  a  far-reaching  eflEect  upon 
school  practice.  It  should,  because  it  is  by  far  the  most  valuable  work  which 
has  been  done  on  minimum  essentials  in  the  field  of  arithmetic.  As  a  survey 
of  the  social  and  business  usage  of  arithmetic  the  monograph  is  a  notable 
contribution  and  will  probably  rank,  as  the  author  suggests,  with  that  of 
Ayres  and  Jones  in  the  field  of  spelling.  To  the  writer  it  appears,  however, 
that  he  has  lost  sight  of  certain  important  considerations  in  applying  the 
results  of  his  survey  to  the  making  of  a  curriculum  for  arithmetic,  as  is 
indicated  in  the  implied  assumptions  given  above.  Some  of  his  conclusions 
with  respect  to  the  curriculum  will  probably  stand  when  a  more  conservative 
and  analytical  interpretation  is  made  of  the  data  collected,  but  all  of  them 
should  not  be  accepted  until  the  effect  of  the  implied  assumptions  and  possi- 
bly of  other  factors  is  known. 

W.  S.  M. 


Standardized  Tests  for  the  High  School 
{Continued  from  March  number  page  242) 
C.     Algebra  (Continued) 
Stromquist's  Preliminary  Algebra  Tests.     This  series  includes  tests  upon 
the  following  operations:  (1)  addition;  (2)  subtraction;  (3)  multiplica- 
tion; (4)  division;  and  (5)  factoring. 
Publisher:  University  of  Wyoming,  Laramie,  Wyoming. 

Thorndike's  Algebra  Test.  This  is  a  series  of  eight  exercises  arranged  in 
order  of  increasing  difl&culty  as  determined  by  the  opinion  of  competent 
judges. 

Reference:  Thorndike,  E.  L.     "An  experiment  in  grading  problems  in 
algebra,"  Mathematics  Teacher,  6:123-34,  March,  1914. 

D.  Geometry 
Irwin's  Tests  in  Mental  Manipulations  of  Space  Relations.  The  author  feels 
that  this  abihty  is  not  confined  to  mathematics  alone,  but  it  is  constantly 
in  demand  in  other  lines  as  sewing,  general  science,  drawing,  English, 
etc.  He  has,  therefore,  worked  out  four  tests  (Tests  A-D)  which  should 
"yield  a  rough  measure  of  the  ability  of  each  pupil  in  a  class  to  image 
space  relations." 

Address:  H.  N.  Irwin,  Fairmount  Junior  High  School,  Cleveland,  Ohio. 
Reference:  Irwin,  H.  N.     "Preliminary  attempt  to  devise  a  test  of  the 
ability  of  high  school  pupils  in  the  mental  manipulations  of  space 
relations,"    School    Review,    26:600-6,    654-70,    759-72,    October- 
December,  1918. 

The  derivation  of  the  tests  b  described  and  the  tests  are  reproduced. 

Minnick's  Geometry  Tests.  This  series  of  tests  is  based  on  the  assumption 
that  demonstration  of  a  geometrical  theorem  involves  the  following 
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abilities:  (1)  the  ability  to  draw  the  figure;  (2)  the  ability  to  state  the 
hypothesis  and  conclusion;  (3)  the  abiUty  to  recall  facts  cdncerning  the 
figure;  (4)  the  ability  to  select  and  organize  facts  so  as  to  produce  the 
proof. 

Publisher:  J.  H.  Minnick,  University  of  Pennsylvania,  Philadelphia, 
Pennsylvania.  Also  obtainable  from  Bureau  of  Educational  Re- 
search, University  of  Illinois,  Urbana,  Illinois. 
Reference:  Minnick,  J.  H.  "A  scale  for  measuring  pupils'  ability  to 
demonstrate  geometrical  theorems,"  School  Review,  27:101-9, 
February,  1919. 

Study  based  on  tests  given  in  thirty  high  schools  throughout  the  country  and  ranging  in  size 
from  a  few  hundred  pupils  to  several  thousand.  These  pupils  had  completed  either  the  first  two 
books  of  plane  geometry  or  all  of  plane  geometry.    Illustrated  by  graphs  and  tables. 

Minnick,  J.  H.     "Certain  abilities  fundamental  to  the  study  of  geom- 
etry," Journal  of  Educational  Psychology,  9:83-90,  February,  1918. 

The  author  discusses  the  four  abilities  which  are  fundamental  to  the  study  of  geometry;  how 
are  these  abilities  related  to  teaching;  to  what  extent  are  these  four  abilities  developed;  development 
of  a  series  of  tests  which  may  be  used  for  the  purpose  of  diagnosis. 

Minnick,  J.  H.     An  investigation  of  certain  abilities  fundamental  to  the 
study  of  geometry.     Philadelphia:  University  of  Pennsylvania,  1918. 

In  this  monograph  Dr.  Minnick  gives  an  analysis  of  geometrical  ability  and  a  complete  account 
of  the  derivation  of  his  tests. 

Starch's  Geometry  Test. 

Address:  Daniel  Starch,  University  of  Wisconsin,  Madison,  Wisconsii 

Stockard  and  Bell  Geometry  Test.     A  test  of    seventy    questions    which 
involve  drawing  figures,  naming  figures,  indicating  order  of  development 
in  demonstration,  completing  statements,  stating  the  converse,  defini- 
tions, regular  polygons,  parts  of  a  demonstration,  etc. 
Stockard,  L.  V.  and  Bell,  J.  Carleton.     "A  preliminary  study  of  the 

measurement  of  abilities  in  geometry,"  Journal  of  Educational 

Psychology,  7:567-80,  December,  1916. 

Derivation,  preliminary  form  reproduced.    Analysis  of  results. 

IX.  Mental  Tests 

Army  Tests.  The  mental  tests  which  have  been  used  extensively  in  the 
army  were  prepared  by  the  Psychology  Committee  of  the  National 
Research  Council.     Three  systems  of  tests  are  now  in  use : 

1.  Alpha.  This  is  a  group  test  designed  for  men  who  can  read  English. 
It  requires  only  fifty  minutes  to  give.  The  exercises  are  designed  so  they 
may  be  answered  without  writing,  merely  by  underlining,  crossing  out, 
or  checking.  The  papers  may  be  scored  by  means  of  stencils,  so  that 
nothing  is  left  to  the  personal  judgment  of  those  who  do  the  scoring,  f^ 

2.  Beta.  This  is  a  group  test  for  foreigners  and  illiterates.  Success  in 
Beta  does  not  depend  upon  knowledge  of  the  English  language,  as  the 
instructions  are  given  entirely  by  pantomime  and  demonstration. 

3.  Individual  Tests.  Three  forms  of  individual  tests  are  used:  Yerkes- 
Bridges  Point  Scale,  the  Stanford-Binet  Scale,  and  the  Performance 
Scale. 
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Address:  Division  of  Psychology,  Medical  Department,  War  Depart- 
ment, Washington,  D.  C. 

References:  Army  mental  tests,  methods,  typical  results,  and  practical 
application.    Washington,  D.  C,  November,  1918. 

This  bulletin  describes  the  three  types  of  tests  used  in  the  army.  It  also  gives  an  explanation  of 
letter  ratings  and  directions  for  the  use  of  intelligence  ratings. 

Madsen,  I.  N.  and  Sylvester,  R.  H.  "High  school  students'  intelligence 
ratings  according  to  the  alpha  army  test,"  School  and  Society, 
10:407-10,  October  4,  1919. 

Results  of  the  Alpha  test  given  to  the  jhigh-school  students  of  Rockford,  Illinois,  Madison, 
Wisconsin,  and  Sioux  City,  Iowa. 

Van  Wagenen,  M.  J.  "Our  schools  as  measured  by  the  army  tests," 
Educational  Administration  and  Supervision,  5:163-76,  April,  1919. 

Mr.  Van  Wagenen  states:  "The  use  of  the  Army  Tests  in  certain  elementary  schools,  high 
schools,  and  universities  for  the  purpose  of  gathering  information  for  the  use  of  psychologists  in  the 
army  has,  at  the  same  time,  revealed  very  clearly  certain  facts  about  the  schools,  the  students 
tested,  and  possible  values  of  mental  tests  in  educational  practice."  The  author  describes  Army 
Test  E  and  compares  it  with  Alpha,  form  6.  Table  II  gives  the  weighted  scores  of  elementary  school 
pupils,  high  school  freshmen,  and  college  men  and  women. 

Materials  from  the  Army  Tests  under  the  title  of  "National  Intelli- 
gence Tests"  have  been  standardized  by  a  committee  of  the  National 
Research  Council.  They  are  to  be  published  this  spring,  1920,  by  the 
World  Book  Company,  Yonkers,  New  York. 

Holley's  Sentence  Vocabulary  Scale.  This  scale  has  been  devised  with  the 
Terman  Stanford-Binet  Vocabulary  as  a  basis.  The  words  of  this  well- 
known  vocabulary  are  put  in  sentences,  the  last  word  of  which  is  found 
among  four  words  to  the  right.  The  pupils  indicate  the  correct  responses 
by  underlining  the  word  which  completes  the  sentence.  This  scale  has 
been  found  to  be  a  fair  measure  of  intelligence.  Series  3B  is  for  grades 
VII  to  XII. 
Publisher:  Bureau   of   Educational   Research,    University   of   Illinois, 

Urbana,  Illinois. 
Reference:  First  annual  report  of  Bureau  of  Educational  Research,  1918- 

1919. 

Otis'  Group  Intelligence  Scale.    This  scale  is  composed  of  ten  tests  which 

measure  various  phases  of  mental  ability.    Two  forms  of  the  scale  are 

available.     They  may  be  used  in  grades  vi  to  xii. 

Publisher:  World  Book  Company,  Yonkers,  New  York. 

References:  Otis,  A.  S.  "An  absolute  point  scale  for  the  group  measure- 
ment of  intelligence,"  Journal  of  Educational  Psychology,  9:239-61, 
333-48,  May- June,  1918. 

Report  of  the  Department  of  Research,  being  part  of  a  report  of  the  superin- 
tendent of  schools  of  Oakland,  California,  1917,  p.  210. 

Theisen  and  Fleming's  Classification  Test.  A  group  test  based  on  the  Army 
Test  (Alpha),  has  been  successfully  used  for  high-school  purposes.  Takes 
fifty  minutes  to  give  and  may  be  scored  at  the  rate  of  15  papers  per  hour. 
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Publisher:  Bureau  of  Publications,  Teachers  College,  Columbia  Univer- 
sity, New  York  City. 

Reference:  An  article  by  Dr.  Theisen  entitled,  "Group  Intelligence 
Tests,"  will  appear  in  an  early  number  of  the  Journal  of  Educational 
Research. 

Thurstone's  Psychological  Examination  for  College  Freshmen  and  High 
School  Seniors. 

Address:  L.  L.  Thurstone,  Carnegie  Institute  of  Technology,  Pittsburgh, 
Pennsylvania. 

X.    Music 
Baldwin's  Public  School  Music  Test.    A  preliminary  test  of  the  efficiency  of 
public  school  music.     It  is  aimed  to  measure  the  accomplishment  of 
pupils.  In  this  respect  it  is  similar  to  the  Courtis  Standard  Research  Tests 
in  Arithmetic. 

Reference:  Baldwin,  Ralph.  "Efficiency  in  school  music  teaching  and 
practical  test  of  the  same,"  Music  supervisors^  national  conference 
proceedings,  1914,  p.  43-50. 

On  page  46  the  test  is  reproduced. 

Seashore's  Musical  Talent  Chart.  This  chart  is  based  upon  the  analysis  of 
musical  ability  and  offers  a  graphic  means  of  representing  the  pupil's 
musical  ability.  The  pupil's  musical  abilities  are  measured  by  his 
response  to  tones  which  are  mechanically  produced.  The  chart  is 
simply  a  convenient  device  for  recording  the  responses  of  the  pupil. 
The  records  for  testing  a  child  are  made  by  the  Columbia  Graphophone 
Company,  Woolworth  Building,  New  York.  The  Manual  for  Measures 
of  Musical  Talent,  furnished  free  by  the  Educational  Department  of  the 
Columbia  Graphophone  Company,  contains  directions,  norms,  and 
interpretations. 

References:  Seashore,  C.  E.  "The  measurement  of  musical  talent," 
Musical  Quarterly,  1:129-48,  January,  1915. 

A  discussion  of  the  elements  which  make  up  musical  talent  and  the  derivation  of  the  Musical 
Talent  Chart,  the  chart  itself,  and  its  meaning  and  use. 

Seashore,  C.  E.  "The  r6le  of  a  consulting  supervisor  in  music,"  Eight- 
eenth Yearbook  of  the  National  Society  for  the  Study  of  Education, 
1919,  part  II,  p.  111-23. 

Account  of  the  use  of  the  test  in  the  elementary  schools  and  with  adults.    Mr.  Seashore  states 
that  the  best  time  to  use  the  chart  is  in  the  fifth  grade. 

Seashore,  C.  E.  The  psychology  of  musical  talent.  Boston:  Silver 
Burdett  and  Company,  1919. 

The  system  of  evaluation  of  musical  talents  is  reviewed  and  a  chapter  is  devoted  to  each  of  the 
five  double  disk  records. 

Seashore,  C.  E.  Vocational  guidance  in  music.  (University  of  Iowa 
Monographs,  first  series,  no.  2,  September,  1916.) 

Copies  may  be  obtained  on  request  from  the  librarian  of  the  University  of  Iowa,  Iowa  City, 
Iowa.    A  discussion  of  the  value  of  the  Musical  Talent  Chart. 

"Testing  for  musical  talent,"  Musician,  24:10,  July,  1919. 

A  discussion  of  Seashore's  tests. 
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XI.  Physical  Training 
Athletic  Badge  Tests  for  Boys.  These  tests  are  not  a  complete  measure  of 
physical  efficiency,  but  they  serve  as  a  fair  index  of  heart,  lung,  and 
muscular  development.  They  comprise  a  sixty-yard  dash,  standing 
broad  jump,  and  a  pull  up.  Standards  have  been  worked  out.  These 
tests  have  been  used  in  the  high  schools  of  Gary,  New  Orleans,  Seattle, 
Buffalo,  and  New  York. 
Publisher:  Playground  and  Recreation  Association  of  America,  1  Madison 

Avenue,  New  York  City. 
Reference:  Hanmer,  L.  F.    Gary  public  schools:  physical  training  and 

play.    New  York:  General  Education  Board,  1919, 

Athletic  Badge  Tests  for  girls.    This  test  is  similar  to  the  one  for  boys,  but 
being  a  newer  series  has  no  standard. 
Publisher:   Playground     and     Recreation     Association    of     America, 

1  Madison  Avenue,  New  York  City. 
Reference:  Hanmer,  L.  F.    Gary  public  schools:  physical  training  and 

play.    New  York:  General  Education  Board,  1919. 

Mr.  Hanmer  states:  "The  results  (for  the  girls)  are  therefore  no  more  satisfactory  than  the 
results  of  the  boys'  test.    There  is  also  the  same  unevenness  and  irregularity  in  development." 

Baldwin's  Physical  Development  Scale.  Separate  scales  are  given  for  boys 
and  girls.  Each  scale  gives  norms  for  height,  weight,  and  breathing 
capacity  for  each  year  from  the  kindergarten  to  the  last  year  of  the  high 
school.  This  scale  is  included  in  Rapeer's  Scale  for  Measuring  Physical 
Education. 

Address:  Bird  T.  Baldwin,  University  of  Iowa,  Iowa  City,  Iowa. 
Reference:  Baldwin,  B.  T.    "A  measuring  scale  for  physical  growth  and 
physiological  age,"  Fifteenth  Yearbook  of  the  National  Society  for 
the  Study  of  Education,  1916,  part  I,  pp.  20-21. 

Rapeer's  Scale  for  Measuring  Physical  Education.    This  is  a  score  card  for 
judging  five  aspects  of  the  results  of  physical  education,  i.e.,  health, 
physiological  efficiency,   physical  development,   physical   ability   and 
mental  qualities. 
Address:  L.  W.  Rapeer,  1719  H.  Street  N.  W.,  Washington,  D.  C. 

XII.    Reading 
Kansas  Silent  Reading  Tests.    Test  III  of  this  series  is  designed  for  the  high 
school.    It  consists  of  a  series  of  exercises  in  which  the  pupil  is  asked  to 
read  a  short  paragraph  and  answer  a  single  question  on  it.    The  adminis- 
tration of  the  test  is  very  simple  and  it  has  been  very  widely  used. 
Publisher:  Bureau  of  Educational  Measurements  and  Standards,  Kan- 
sas State  Normal  School,  Emporia,  Kansas. 
References:  Kelly,  F.  J.     The  Kansas  Silent  Reading  Test  (Studies  by 
the  Bureau  of  Educational  Measurements  and  Standards,  No.  3), 
Emporia,  Kansas:  Kansas  State  Normal  School,  1915. 

This  contains  the  complete  account  of  the  derivation  of  the  test. 
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Kelly,  F.  J.  "The  Kansas  silent  reading  test,"  Journal  of  Educational 
Psychology,  7:63-80,  February,  1916. 

This  is  a  partial  account  of  the  derivation  of  the  test. 

Monroe,  Walter  S.  "A  report  on  the  use  of  the  Kansas  silent  reading 
tests  with  over  one  hundred  thousand  children,"  Journal  of  Educa- 
tional Psychology,  9:600-8,  December,  1917. 

The  author  concludes  that  the  Kansas  tests  place  more  emphasis  up>on  comprehension  than 
upon  rate  of  reading. 

Smith,  B.  M.  "Correlation  of  ability  in  reading  with  the  general  grades 
in  high  school,"  School  Review,  27:493-511,  September,  1919. 

In  trying  to  determine  the  correlation  between  abilities  in  reading  and  school  abilities  in  the 
Oak  Park,  Illinois,  high  school  Miss  Smith  used  the  Kansas  SUent  Reading  and  three  other  tests 
which  she  devised.   Correlations  are  given  for  Kansas  Silent  Reading  as  well  as  the  other  tests. 

An  educational  survey  of  Janesville,  Wisconsin.  Madison,  Wisconsin: 
State  Department  of  PubUc  Instruction,  1918,  p.  261. 

An  account  of  the  use  of  the  Kansas  Silent  Reading  tests  in  high  schooL 

Monroe's  Standardized  Silent  Reading  Tests.    This  series  of  silent  reading 
tests  is  essentially  a  revision  of  the  Kansas  Silent  Reading  Tests  de- 
scribed above. 
Publisher:  Bureau   of   Educational   Research,    University   of   Illinois, 

Urbana,  Illinois. 
Reference:  Monroe,  Walter  S.    "Monroe's  standardized  reading  tests," 

Journal  of  Educational  Psychology,  9:303-12,  June,  1918. 

This  is  an  account  of  the  derivation  of  the  revision.  The  Kansas  Silent  Reading  Tests  have 
been  criticized  because  many  of  the  tests  resembled  arithmetical  puzzles  rather  than  ordinary  reading 
nvaterial.    In  the  revision  the  paragraphs  have  been  selected  from  school  readers. 

School  report  of  the  town  of  Southington,  Connecticut,  1919,  p.  17. 

An  account  of  the  use  of  these  tests  in  the  high  school. 

Neher's  High  School  Vocabulary  Scale.  A  test  consisting  of  one  hundred 
words  chosen  from  the  top  of  every  third  column  of  Laird  and  Lee's 
Vest  Pocket  Dictionary. 

Address:  H.  L.  Neher,  Northwestern  University,  Evanston,  Illinois. 
Reference:  Neher,  H.  L.     "Measuring  the  vocabulary  of  high  school 
pupils,"  School  and  Society,  8:355-59,  September  21,  1918. 

Reproduction  of  the  test,  scores  obtained  through  experimentation  and  conclusions  reached. 

St.  Paul  Survey  Silent  Reading  Scale  for  High  School.  This  scale  is  similar 
to  Minnesota  Scale  Beta,  the  derivation  of  which  is  based  on  Thorn- 
dike's  Scale  Alpha  2. 

References:  Report  of  a  survey  of  the  school  system,  St.  Paul,  Minnesota, 
1917,  p.  375-401. 

The  tests  and  questions  are  reproduced.  Methods  of  scoring  and  a  comparison  of  scores  is 
also  given. 

Haggerty,  M.  E.  and  Thomas,  M.  J.  "Preliminary  study  of  the  reading 
attainments  of  college  freshmen,"  School  and  Society,  6:230-38, 
August  25,  1917. 

The  test  was  given  to  the  college  freshmen  and  was  also  given  to  two  hundred  and  fifty  members 
of  the  senior  class  in  the  St.  Paul  high  school.  The  test  which  is  reproduced  in  this  article  includes  a 
number  of  the  exercises  from  the  St.  Paul  Survey  Test. 
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Smith's  Silent  Reading  Paragraphs  for  High  Schools.     Miss  Smith  has 
devised  three  informal  silent  reading  tests.  The  tests  are  as  follows: 
Test  /.  Paragraph  Test.    Ability  to  grasp  central  idea.    Four  paragraphs 

were  chosen  from  "A  Father  to  His  Freshman  Son  in  College," 

{Atlantic  Monthly). 
Test  II.  Information   Test.     Ability  to  recall  items  of  information. 

Selections  were  taken  from  the  Independent. 
Test  III.   Narrative  Test.    Ability  to  follow  plot.    Selection  was  a  story 

from  an  inside  page  of  Chicago  Daily  Tribune. 
Address:  Bertha  M.  Smith,  Oak  Park  High  School,  Oak  Park,  Illinois. 
Reference:  Smith,  B.  M.    "Correlation  of  ability  in  reading  with  general 

grades  in  high  school,"  School  Review,  27:493-511,  September,  1919. 

The  tests  were  given  to  determine  the  correlation  between  abilities  in  reading  and  school 
abilities.   The  four  reading  tests  used  are  described  and  the  author's  three  tests  are  reproduced. 

Starch's  English  Vocabulary  Test.  This  test  is  designed  to  measure  the 
percent  of  words  of  the  entire  English  vocabulary  as  well  as  the  absolute 
number  of  words  that  a  person  understands.  The  test  consists  of  several 
sets  of  one  hundred  words  which  were  selected  at  uniform  intervals  from 
the  entire  English  vocabulary — Webster's  New  International  Dic- 
tionary. 

Address:  Daniel  Starch,  University  of  Wisconsin,  Madison,  Wisconsin. 
Reference:  Starch,    Daniel.    Educational   measurements.      New    York: 
Macmillan,  1916,  p.  38  ff. 

The  test  is  reproduced.  Tentative  scores  are  shown  for  different  grades  in  the  high  school  as 
well  as  for  elementary  school  and  college. 

Thorndike's  Scale  Alpha  2  for  Measuring  the  Understanding  of  Sentences. 

This  scale  consists  of  a  series  of  paragraphs  and  questions  about  the 
paragraphs  arranged  in  order  of  difficulty  of  comprehension.  This  scale 
measures  only  the  degree  of  comprehension  and  does  this  in  terms  of 
difficulty  of  the  exercise  which  the  pupil  is  able  to  do  80  percent  correctly. 
Part  II  may  be  used  in  grades  VI  to  XII. 

Publisher:  Bureau  of  Publications,  Teachers'  College,  Columbia  Univer- 
sity, New  York  City. 
References:  Thorndike,  E.  L.    "Improved  scale  for  measuring  ability  in 
reading,"  Teachers  College  Record,  16:445-67,  17:40-67,  November, 
1915,  January,  1916. 

The  test,  key  and  score  sheet  are  reproduced  in  the  November  issue  along  with  the  discussion  of 
the  use  of  the  scale  method  of  scoring,  and  the  interpretation  of  scores.  The  derivation  of  the 
test  is  in  the  November  number. 

Kelley,  T.  L.    "Thorndike's  reading  scale  alpha  2  adapted  to  individual 
testing,"  Teachers  College  Record,  18:253-60,  May,  1917. 

Directions  for  using  the  scale  with  individual  rather  than  with  the  class  as  the  author  intended. 

XIII.    Science 
A.  General 
Caldwell's  Science  Tests.     The  tests  may  be  divided  into  three  groups. 
Group  I  consisting  of  two  pairs  of  tests  deals  with  observation  and  dis- 
crimination.   Group  II  relates  primarily  to  the  pupil's  ability  to  recog- 
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nize  natural  phenomena,  to  recall  experiences  in  science  study  and  to 
make  constructive  statements  regarding  these  experiences.  Group  III 
consists  of  two  tests  of  ability  to  give  reasons  for,  to  interpret,  or  to 
explain  changing  phenomena — the  changes  occurring  in  the  presence  of 
pupils  in  the  form  of  an  experiment  or  demonstration.  These  tests  were 
used  in  the  senior  classes  of  the  Gary,  Indiana  high  school. 
Reference:  Caldwell,  O.  W.  The  Gary  public  schools:  science  leaching. 
New  York:  General  Education  Board,  1919. 

Chapter  X  is  devoted  especially  to  the  reproduction  of  the  tests  which  have  been  prepared  by 
Mr.  Caldwell. 

Downing's  Information  Tests  in  Science.  A  vocabulary  test  of  one  hundred 
scientific  terms  covering  the  entire  field  of  high-school  science.  The 
pupils  are  asked  to  put  the  letter  "E"  before  a  word  he  can  explain,  and 
the  letter  "F"  before  a  word  which  he  has  heard  about. 
Address:  Elliot  R.  Downing,  University  of  Chicago,  Chicago,  Illinois. 
Reference:  Downing,  E.  R.  "A  range  of  information  tests  in  science," 
School  Science  and  Mathematics,  19:228-33,  March,  1919. 

The  author  reproduces  the  list  of  one  hundred  terms  and  states  results  with  about  fifteen 
hundred  students  in  seventh  and  eighth  grades,  high  school,  and  university. 

Grier's  Range  of  Information  Test  in  Biology. 

Reference:  Grier,  N.  M.  "Range  of  information  test  in  biology," 
Journal  of  Educational  Psychology,  9:210-16,  388-93,  April-Septem- 
ber, 1918. 

The  design  of  the  tests  is  that  described  by  Whipple  in  his  Range  of  Information  Test.    The 
first  number  contains  a  description  of  a  test  in  physiology  and  the  second  one  in  zoology. 

Herring's  Tests  in  Scientific  Thinking.    Series  of  three  tests  on  each  of  eleven 
abilities  involved  in  scientific  thinking. 
Reference:  Herring,  J.  P.    "Measurements  of  some  abilities  in  scientific 

thinking,"  Journal  of  Educational  Psychology,  9:535-58,  December, 

1919. 

The  tests  are  reproduced  and  results  of  their  application  to  one  pupil  is  given. 

Ruch's  Range  of  Information  Test  in  General  Science.    This  test  consists  of 
fifty  scientific  terms  assembled  upon  the  basis  of  frequency  in  general 
science  texts.    As  three  series  of  words  are  given,  a  different  series  may 
be  given  during  the  year. 
Address:  G.  M.  Ruch,   School  of  Education,  University  of  Oregon, 

Eugene,  Oregon. 
Reference:  Ruch,   G.   M.     "A  range  of  information  test  in  general 

science,"  General  Science  Quarterly,  4:257-62,  November,  1919. 

Describes  the  derivation  of  the  test  which  is  reproduced.   The  method  for  scoring  is  discussed. 

B.  Chemistry 
Bell's  First- Year  Chemistry  Test.    A  test  of  25  questions  which  the  author 
considered  basic  for  elementary  chemistry. 

References:  Bell,  J.  C.  "Study  of  the  attainments  of  high  school  pupils 
in  fijst-year  chemistry,"  School  Science  and  Mathematics,  18:425-32, 
May,  1918. 

Brief  account  of  its  derivation.    Results  from  401  pupils  analyzed. 
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Bell,  J.  Carleton.  "A  test  in  first  year  chemistry,"  Journal  of  Educa- 
tional Psychology,  9:199-209,  April,  1918. 

This  is  the  complete  report  of  which  the  above  is  a  preliminary  statement. 

Jones'  Chemistry  Tests.    (Union  Science  Series,  See  Physics.) 

Address:  F.  T.  Jones,  10109  Wilbur  Avenue,  Cleveland,  Ohio. 

Rivett's  Time  Limit  Test  in  Chemistry.  The  article  presents  two  types  of 
simple  tests  which  are  arranged  for  beginners.  They  are  intended  as 
suggestive  types  of  tests  which  teachers  of  chemistry  may  easily  devise. 
The  pupils  may  score  these  tests  themselves. 

Address:  B.  J.  Rivett,  Northwestern  High  School,  Detroit,  Michigan. 
Reference:  Rivett,    B.    J.      "Testing    results    in    chemistry,"    School 
Science  and  Mathematics,  19:742-45,  November,  1919. 

Two  types  of  tests  are  reproduced.    Advantages  over  the  old  form  examination  are  stated  in 
conclusion. 

Webb's  Preliminary  Test  in  Chemistry.     Test  requires  pupils  to  classify 
fifty  well-known  substances  as  elements,  compounds,  or  mixtures. 
Address:  Hanor  Webb,  George  Peabody  College  for  Teachers,  Nashville, 

Tennessee. 
Reference:  Webb,  Hanor.    "A  preliminary  test  in  chemistry,"  Journal 

of  Educational  Psychology,  10:36-43,  January,  1919. 

This  is  an  account  of  the  use  of  the  author's  test  with  a  number  of  his  classes. 

C.  Geography 
Boston  Geography  Test.     A  forty-minute  test  on  United  States  and  the 

countries  of  Europe.    Although  the  tests  were  given  to  elementary,  high, 

and  normal  school  pupils,  particular  interest  centers  in  the  results 

achieved  by  the  eighth  grade. 

Address:  Leonard  O.  Packard,  Boston  Normal  School,  Boston,  Massa- 
chusetts. 

Reference:  Geography.  A  report  on  a  preliminary  attempt  to  measure 
some  educational  results.  (Bulletin  No.  5  of  the  Department  of 
Educational  Investigation  and  Measurement,  Boston  Public 
Schools,  1916.) 

Discussion  of  the  tests  with  reproduction,  but  method  of  giving  and  of  rating  is  not  shown. 
Results  for  high-school  students  are  given. 

D.  Physics 
Chapman's  Physics  Test  in  Electricity  and  Magnetism,  Sound  and  Light. 
Address:  J.  Crosby  Chapman,  Western  Reserve  University,  Cleveland, 

Ohio. 
Reference:  Chapman,  J.  C.    "The  measurement  of  physics  information," 
School  Review,  27:748-49,  December,  1919. 

The  test  with  answers  is  reproduced.    Results  for  158  high-school  pupils  are  tabulated. 

Jones'  Union  Science  Tests.    These  tests  form  an  elaborate  series  covering 
many  of  the  topics  of  the  subject.    There  is  a  separate  test  for  each  topic. 
Address  and  send  results  to:  Franklin  T.  Jones,  10109  Wilbur  Avenue, 
Cleveland  Ohio. 
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Reference:  Jones,  F.  T.    "Practice  exercises  in  physics,"  School  Review, 
26:341-48,  May,  1918. 

Describes  the  Union  Science  Tests — a  series  in  physics.     Test  Hj-Test  Hj,  and  Test  Hj  are 
reproduced,  with  results  analyzed. 

Randall,  Chapman  and  Sutton's  Test  in  Mechanics.  A  simple  test  of  a  set 
of  progressive  problems  in  mechanics. 

Address  authors:  Western  Reserve  University,  Cleveland,  Ohio. 
Reference:  Randall,  D.  P.,  Chapman,  J.  C.  and  Sutton,  C.  W.     "The 

place  of  the  numerical  problem  in  high  school  physics,"  School 

Review,  26:39-43,  January,  1918. 

The  test  is  reproduced.   Results  from  experimental  testing  with  four  high  schools  are  given. 

Starch's  Physics  Test.  This  test  is  composed  of  75  sentences  which  are 
arranged  in  the  form  of  a  completion  test.  The  degree  to  which  the 
pupils  have  mastered  the  work  in  physics  covered  by  these  sentences  is 
shown  by  their  ability  to  fill  in  the  missing  words,  phrases,  and  numbers. 
The  test  is  broken  up  into  topics  and  standard  scores  for  each  topic  are 
printed  on  the  test  sheet.  There  are  28  sentences  on  mechanics,  eight  on 
heat,  nine  on  light,  and  21  on  magnetism  and  electricity. 
Publisher:  Daniel  Starch,  University  of  Wisconsin,  Madison,  Wisconsin. 
Also  obtainable  from  Bureau  of  Educational  Research,  University  of 
Illinois,  Urbana,  Illinois. 

Reference:  Starch,   Daniel.      Educational  measurements.     New   York: 
MacmiUan,  1916,  chapter  XIV. 

XIV.   Vocational  Subjects  and  Manual  Training 
Leavitt's  Preliminary  Test  for  Manual  Arts.    As  the  title  suggests  this  is  only 
a  preUminary  test,  not  designed  by  the  author  for  general  use. 
Address:  F.  M.  Leavitt,  Associate  Superintendent  in  Charge  of  Voca- 
tional Education,  Pittsburgh,  Pennsylvania. 

Reference:  Leavitt,  F.  M.    "Standardized  measurements  in  the  field  of 
industrial  arts,"  Industrial  Arts  Magazine,  8:132-8,  April,  1919. 

Brief  discussion  of  methods  of  producing  and  using  standardized  tests  is  given.   The  preliminary 
scale  for  manual  arts  is  reproduced. 

Wardner's  Test  for  Knowledge  of  Tools.  This  is  a  modification  of  one  of  the 
Army  Trade  Tests.  Pupils  are  asked  to  identify  81  tools.  Test  is 
reproduced. 

Address:  C.    A.    Wardner,    Director   of    Cooperative   Trade    Schools, 
Springfield,  Vermont. 

Reference:  Wardner,  C.  A.    "Applying  the  army  trade  tests  to  vocational 
schools,"  Industrial  Arts  Magazine,  8:402-03,  October,  1919. 

A  reproduction  and  brief  discussion  of  this  test  which  is  being  used  in  the  Cooperative  Trade 
School,  Springfield,  Vermont. 

(The  Etui) 


In  the  spring  of  1919  the  General  Education  Board 
National  appropriated  $25,000  to  the  National  Research  Council  to 

Intelligence         be  used  for  the  preparation  of  methods  of  measuring  the 
Tests  intelUgence  of  children  in  the  elementary  schools.    A  com- 

mittee consisting  of  Dr.  M.  E.  Haggerty,  Dr.  L.  M.  Terman, 
Dr.  E.  L.  Thorndike,  Dr.  G.  M.  Whipple,  and  Dr.  R.  M.  Yerkes,  Chairman, 
was  organized  to  undertake  this  task. 

This  committee  has  prepared  two  scales,  the  tests  of  which  are  listed 
below. 

Tests  of  Scale  A  Tests  of  Scale  B 

Arithmetical  Reasoning  Computation 

Sentence  Completion  Information 

Logical  Selection  Vocabulary 

Synonym-Antonym  Analogies 

Symbol-Digit  Comparison 

Either  of  these  scales  may  be  used  alone,  but  the  committee  expects  to 
recommend  re-examination  by  the  second  scale  after  an  interval  of  at  least 
one  day,  in  order  that  the  reliability  of  the  intelligence  measurement  may  be 
increased.  It  is  deemed  preferable  by  the  committee  to  use  two  short  scales 
in  the  way  suggested,  rather  than  to  use  a  single  longer  scale,  the  application 
of  which  would  require  approximately  an  hour  of  continuous  work.  Examina- 
tion by  either  of  the  proposed  scales,  A  or  B,  will  require  approximately  thirty 
minutes. 

Materials  have  been  prepared  by  the  committee  for  ten  alternative  forms 
of  each  of  the  ten  tests  which  have  been  selected  for  use,  but  it  is  planned  to 
complete  for  immediate  publication  only  five  forms  of  each  test  and  of  each 
scale.  The  remaining  materials  will  be  held  subject  to  later  development  as 
needed. 

It  has  been  arranged  that  the  World  Book  Company  of  Yonkers,  New 
York,  shall  pubhsh  these  new  tests  under  ihe  title  "National  Intelligence 
Tests."  It  is  expected  that  the  materials,  which  will  consist  of  record  blanks, 
examiner's  guide,  and  scoring  keys,  will  be  ready  for  distribution  in  the 
spring  of  1920.  Royalties  from  the  publications  will  be  used  for  further 
research  on  methods  of  measuring  intelligence  and  the  practical  application 
of  such  methods. 

Robert  M.  Yerkes 

Chairman 

321 


322 


JOURNAL  EDUCATIONAL  RESEARCH 


Vol.  1,  No.  4 


The  conclusions  of  E.  J.  Ashbaugh  concerning  the  necessity  of  teaching 
derived  forms  in  spelling^  have  been  confirmed  by  the  results  obtained  in  tests 
given  by  the  Department  of  Educational  Investigation  and 
Need  to  Teach  Measurement,  Boston,  Massachusetts.  While  his  data  are 
Spelling  of  based  on  tests  given  in  the  lower  elementary  grades  (li  to 

Derivatives  v),  the  data  of  this  department  are  based  on  results  obtained 
in  grades  VI  and  VII.  There  is  also  this  difference  in  the  two 
investigations.  The  words  tested  by  Ashbaugh  may  or  may  not  have  been 
studied  by  the  pupils  since  the  tests  were  not  organized  on  that  basis,  while 
in  the  Boston  tests  the  root  words  given  were  specifically  chosen  from  the 
Boston  minimum  spelling  list  which  the  pupils  had  studied. 

Undoubtedly  the  adding  of  a  sufl&x  to  a  word  makes  that  word 
harder  to  spell  and  we  have  no  right  to  presuppose  that  pupils  can  spell 
derived  words  the  roots  of  which  they  are  able  to  spell.    This  is  shown  con- 

COMPARISON  OF  ROOTS  AND  DERIVATIVES 

(All  root  words  occur  in  sixth-minimum  list) 


Root  Words 

Percent 

Derivatives 

Percent 

Correct 

Correct 

abbreviate 

78 

abbredates 

75 

absence 

8.5 

absences 

75 

accidents 

90 

accidents 

77 

arrange 

92 

arranging 

86 

attack 

94 

attacked 

87 

attacking 

94 

boundary 

87 

boundaries 

67 

century 

93 

centuries 

77 

commence 

85 

commenced 

81 

commencing 

74 

conquer 

89 

conquered 

80 

deceive 

80 

deceiving 

70 

decide 

87 

decided 

85 

deciding 

76 

describe 

82 

describing 

76 

industry 

96 

industries 

79 

judge 

98 

judges 

93 

material 

84 

materials 

75 

mosquito 

94 

mosquitoes 

59 

recognize 

87 

recognized 

85 

return 

98 

returned 

93 

returning 

95 

salary 

96 

salaries 

77 

telegraph 

98 

telegraphed 

90 

telephone 

98 

telephoned 

95 

ventilate 

87 

ventilated 

85 

wharf 

99 

wharves 

69 

1  Reported  at  February  1919  meeting  of  the  National  Association  of  Directors  of  Educational 
Research  and  in  Journal  of  Educational  Psychology,  March,  1919,  p.  143. 


AprU,  1920  NEWS  ITEMS  AND  COMMUNICATIONS  323 

clusively  in  the  results  of  spelling  tests  given  in  Boston  in  1916,'  1917,  and 
1919.  In  each  of  the  years  1916  and  1917  a  seventh-grade  division  of  approxi- 
mately 1,000  pupils  was  given  a  list  of  root  words  to  spell;  another  seventh- 
grade  division  was  given  derivatives  of  these  same  words;  i.e.,  the  first 
division  spelled  such  words  as  "health,"  "accurate,"  and  "promise,"  while 
the  second  division  spelled  "healthy,"  "accurately,"  and  "promised." 
With  few  exceptions  there  was  a  falling  off,  and  in  some  cases  a  very  large 
falling  off,  in  the  percent  of  accuracy  with  which  the  derived  forms  were 
spelled,  even  in  cases  where  the  difference  in  spelling  was  only  the  addition  of 
"s"  or  "ing"  with  no  change  of  the  existing  root. 

As  a  result  of  these  findings  the  teachers  were  urged  to  teach  in  their 
spelling  lessons  the  more  common  derivatives  in  connection  with  the  root 
word. 

In  the  spelling  test  of  May  1919,  35  sixth-grade  classes  spelled  the  follow- 
ing list  of  23  root  words  (all  included  in  the  sixth-grade  minimum  list)  and 
27  derivatives  of  those  words  with  the  percent  of  accuracy  indicated  in  the 
table  on  page  322. 

In  every  case  but  one  ("attacking")  the  derivative  proved  itself  a  harder 
word  to  spell  even  though  the  teachers  had  been  urged  to  teach  the  common 
derivatives.  Since  it  is  as  important  that  the  pupils  know  how  to  spell  such 
common  words  as  "judges,"  "mosquitoes,"  etc.,  as  well  as  the  root  words, 
every  common  derived  form  must  be  considered  as  presenting  a  new  spelling 
problem  and  must  be  taught  as  such. 

Harriet  M.  Barthelmess 

The  Seventh  Annual  Conference  on  Educational 
Conference  on  Measurements  will  be  held  at  Indiana  University,  Friday 
Educational  and  Saturday,  April  23  and  24.  Indiana  University  was 
Measurements  the  first  institution  to  hold  an  annual  conference  on 
educational  measurements.  These  meetings  are  well  at- 
tended by  the  school  men  of  the  state;  and  the  university  has  brought  to  this 
meeting  year  after  year  speakers  of  national  reputation.  The  committee  in 
charge  of  the  conference  this  year  has  issued  the  following  preliminary  an- 
nouncement : 

"The  principal  speakers  for  the  Seventh  Annual  Conference  on  Educa- 
tional Measurements  will  be  Dr.  Edward  L.  Thorndike  of  Teachers  College, 
Columbia  University,  and  Professor  C.  E.  Seashore  of  the  University  of 
Iowa.  Dr.  Thorndike's  discussions  will  be  along  the  general  lines  of  intelli- 
gence examinations  for  college  entrance,  standardization  of  textbooks,  and 
the  dangers  of  indiscriminate  use  and  misuse  of  educational  tests.  Professor 
Seashore,  who  has  done  some  remarkable  work  in  the  particular  field  he  will 
present,  will  bring  to  the  Conference  the  results  of  his  research  in  the  measur- 
ing of  special  abilities,  particularly  the  measuring  of  ability  in  music." 

*  See  Bulletin  XI  of  the  Department  of  Educational  Investigation  and  Measurement,  Boston,  Massa- 
chusetts. 
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A  number  of^ different  types  of  tests  have  been  devised  for  measuring  the 
silent  reading  vocabulary  of  pupils.  The  best  known  of 
Southington-  these  probably  is  the  Thorndike's  Visual  Vocabulary  Scales 
Plymouth  A2  and  B.    In  these  the  pupil  is  asked  to  indicate  the  class 

English  to  which  the  word  belongs  as  flower,  animal,  or  boy's  name. 

Vocabulary  In  other  vocabulary  tests,  the  pupil  is  asked  to  check  the 

Scale  words  he  knows  the  meaning  of  and  to  write  out  the  meaning 

of  those  concerning  which  he  is  uncertain.  Both  of  these 
plans  have  obvious  limitations.  The  Southington-Plymouth  English  Vocabu- 
lary Scale  devised  by  Ernest  C.  Witham  makes  use  of  a  different  device. 
Fifty  English  words  are  given.  On  the  opposite  page  their  brief  definitions  as 
given  by  Webster's  International  Dictionary  are  printed.  The  pupil  is  to 
record  before  each  definition  the  number  of  the  word  which  it  fits. 

Most  of  the  words  were  selected  from  Ayres  Spelling  Scale.  A  few 
additional  words  were  taken  from  Thorndike's  Visual  Vocabulary  Scale  A2, 
series  x.  The  test  has  been  tentatively  standardized  for  the  eighth  grade 
and  the  high  school.  Copies  of  the  test  can  be  secured  by  addressing  Superin- 
tendent Ernest  C.  Witham,  Southington,  Connecticut. 

Mr.  George  N.  Cade,  Supervisor  of  Elementary  Grades, 
Classifying  Springfield,   Illinois,   gave   Monroe's   Standardized   Silent 

Pupils  in  Reading  Test  II  to  the  vmA  pupils  who  were  promoted  to 

English  high  school  at  the  end  of  the  first  semester.  The  principal  of  the 

high  school  has  classified  these  pupils  in  the  English  depart- 
ment on  the  basis  of  their  ability  to  read  silently  as  shown  by  this  test. 
Since  ability  to  read  silently  is  fundamental  to  practically  all  of  the  work  of 
the  high  school,  classification  of  pupils  on  the  basis  of  this  ability  may  be 
expected  to  effect  a  helpful  organization. 

The  Myers  Mental  Measure  by  Caroline  E.  Myers 
A  Non-Verbal  and  Captain  Garry  C.  Myers,  claimed  by  the  authors  to  be 
Intelligence  the  first  group  intelligence  test  applicable  to  all  ages,  is 
Test  recommended  for  use  in  every  grade  since  the  directions  are 

given  orally  and  since  the  exercises  consist  wholly  of  pic- 
tures. It  can  be  given  to  illiterates  as  well  as  to  those  who  can  read.  The 
time  for  giving  it  is  not  more  than  twenty  minutes.  The  publisher  is  The 
Sentinel,  Carlisle,  Pennsylvania. 

Professor  M.  E.  Haggerty  of  the  University  of  Minne- 
The  Virginia  sota  devised  for  use  in  the  Virginia  School  Survey  two  tests 
School  Survey  of  general  intelligence.  Delta  1  for  grades  one  to  three  and 
Tests  Delta  2  for  grades  three  to  nine;  and  a  test  for  measuring 

achievement  in  reading,  Sigma  1  for  grades  one  to  three. 
These  tests  have  recently  been  published  and  made  available  for  general  use 
by  the  World  Book  Company  of  Yonkers,  New  York.  The  tests  are  accom- 
panied by  a  manual  of  directions  and  keys  for  scoring.  Their  use  in  the 
Virginia  Survey  and  in  a  number  of  cities  elsewhere  in  the  country  insures 
their  standardization. 


•Nattanal  Aasxiriattnn  nf  ^mtlQXB  of 
lEburattnnal  H^B^arrlj 

(E.  J.  AsHBAUGH,  Secretary  and  Editor) 


Even  though  it  is  several  weeks  since  the  meeting  of  the  Department  of 
Superintendence  at  Cleveland,  this  is  the  first  opportunity  to  tell  you,  who 
were  not  fortunate  enough  to  attend,  something  of  the  meetings  of  our 
association  at  that  time. 

The  first  annual  closed  meeting  on  Monday  was  a  decided  success. 
Although  conflict  of  time  with  the  meetings  of  the  College  Teachers  of 
Education  prevented  a  few  members  from  attending,  the  number  present  was 
quite  satisfactory  and  the  program  even  more  so.  Though  announced  as  a 
closed  meeting,  nothing  short  of  a  corporal's  guard  would  have  kept  some 
interested  non-members  out.  It  was  more  than  curiosity  on  their  part,  since 
once  inside  they  remained  throughout  the  meeting. 

The  forenoon  was  given  over  to  the  report  of  the  Committee  on  Standards 
(Mr.  Courtis,  Chairman)  and  a  paper  on  "Diagnosis"  by  Mr.  Kallom  of  Boston, 
the  paper  being  presented  by  Miss  Barthelmess  in  his  absence.  The  report 
of  the  Committee  on  Standards  attempted  to  accomplish  its  task  by:  (1) 
pointing  out  the  problems  to  be  solved,  the  ends  to  be  achieved;  (2)  indicat- 
ing so  far  as  is  at  present  possible  the  criteria  to  be  used  in  judging  of  values; 

(3)  providing  an  incentive  to  induce  workers  to  apply  these  criteria;  and 

(4)  leaving  it  to  a  process  of  natural  selection  to  determine  which  method 
shall  survive.  The  association  plans  to  make  available  to  aU  its  members  as 
well  as  to  the  public  the  terms,  methods,  and  practices  approved.  The  asso- 
ciation passed  a  motion  for  the  reorganization  of  the  committee  with  provision 
for  subcommittees  in  a  number  of  special  fields. 

The  paper  on  "Diagnosis"  set  forth  the  method  the  Boston  department  is 
using  in  acquainting  the  assistant  superintendents  and  masters  with  the 
position  of  classes  relative  to  city  standards.  Although,  as  a  result  of  these 
reports,  considerable  effectiveness  is  being  registered  in  the  teaching;  it  was 
admitted  by  the  speaker  that  as  yet  the  department  has  been  unable  on 
account  of  lack  of  resources  to  accompany  its  reports  to  the  teachers  with 
suggestions  as  to  remedial  measures. 

At  12 :30  luncheon  was  served  in  "our"  private  dining  room.  Thirty  of  the 
members  and  their  guests  participated. 

The  afternoon  program  included  two  papers  on  "The  Evaluation  of  Tests" ; 
one  by  Dr.  Monroe  and  the  other  by  Dr.  T.  L.  Kelley.  Both  speakers  led  the 
members  into  a  very  deep  discussion  of  the  need  for  the  statistical  methods 
involved  in  the  determination  of  the  validity  and  reliability  of  tests.    It 
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involved  a  consideration  of  technic  impossible  for  the  majority  of  us  to 
practice  but  represented  a  phase  of  the  testing  work  in  which  far  too  little 
has  been  done. 

President  Buckingham  gave  the  members  a  brief  history  of  the  evolu- 
tion of  our  official  organ,  the  Journal  of  Educational  Research.  We  were 
delighted  to  learn  that  it  is  exceeding  the  hopes  of  its  founders,  that  it  is 
already  on  a  self-supporting  basis,  and  that  the  first  issue  has  to  be  re- 
printed to  supply  the  demand  for  it. 

At  six  o'clock  we  again  broke  bread  together  in  the  comfortable  adjoining 
room  which  the  hotel  management  had  assigned  to  us.  By  this  time  we 
felt  as  if  we  owned  it. 

On  Thursday  a  program  consisting  of  eleven  numbers  was  presented. 
Judging  from  the  attendance  and  the  comment  of  those  who  heard  our 
offerings,  the  program  was  a  success.  Most  of  the  papers  will  be  published 
in  the  Journal  of  Educational  Research. 

President  Brown  of  Oshkosh  led  off  with  his  paper  on  "Formulation  of 
Method  in  Reading  in  the  Light  of  Recent  Investigations."  As  the  chairman 
said  in  his  introduction,  Mr.  Brown  is  a  conspicuous  example  of  a  school 
man  who  has  become  an  executive  without  ceasing  to  participate  in  research 
work.  The  morning  program  was  organized  about  the  topic  of  reading,  and 
Mr.  Brown's  paper  afforded  a  good  introduction  to  the  work  of  the  morning. 

Dr.  Theisen  handled  the  subject  of  "Provisions  for  Individual  Differences 
in  the  Teaching  of  Reading"  in  an  effective  manner.  He  has  gathered  mater- 
ial from  more  than  one  hundred  teachers  on  the  provisions  which  they  are 
making  and  the  provisions  which  they  feel  ought  to  be  made  for  adjusting 
the  teaching  of  reading  to  differences  in  ability  among  children.  The  report 
was  interesting  because  it  showed  just  what  the  teachers  are  thinking  about 
on  the  important  matter  of  fitting  instruction  to  the  needs  of  pupils. 

Mr.  Kallom  was  to  have  presented  a  paper  on  "Reproduction  as  a  Measure 
of  Ability."  He  was,  however,  at  the  last  minute,  obliged  to  remain  at  home 
on  account  of  illness  in  his  family.  We  were  sorry  indeed  not  to  greet  Kallom 
but  his  paper  was  so  capably  presented  by  Miss  Barthelmess,  his  assistant  at 
the  Boston  Department  of  Research,  that  we  almost  forgot  our  disappoint- 
ment. The  point  of  the  paper  was  that  children  reproduce  what  they  have 
read  in  terms  of  their  experience.  Some  of  the  responses  of  children  were 
interesting  not  only  from  a  scientific  point  of  view  but  also  were  worthy  of  a 
place  among  the  "bright  sayings"  of  children. 

Doctor — or  shall  we  say  Colonel — Ayres  dodged  the  use  of  slides  and 
brought  his  own  charts.  This  was  a  wise  precaution  on  his  part,  for  we  were 
having  trouble  with  our  lantern.  These  charts  he  comfortably  set  up  and 
proceeded  to  offer  an  admirable  paper  on  "The  Comparative  Effectiveness 
of  State  School  Systems."  He  began  by  going  back  to  1750  at  which  time  an 
Italian  article  was  published  on  the  high  cost  of  living.  In  this  article  index 
numbers  were  used  practically  as  they  are  now  employed  in  economics.  The 
speaker  discussed  the  meaning  and  use  of  the  index  number  and  showed  how 
it  could  be  applied  in  education.  He  made  the  application  on  eight  items  to 
the  schools  of  each  of  the  states.    These  states  were  ranked  on  the  basis  of 
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each  of  the  eight  items  according  to  their  index  numbers.  Comparisons  were 
also  made  with  Dr.  Ayres'  previous  study  of  conditions  in  1910. 

Last  year,  our  association  authorized  a  committee  on  standards.  The 
president,  however,  seemed  to  have  been  particularly  successful  in  selecting 
men  who  were  about  to  retire  from  research  work  and  from  membership  in 
the  organization.  The  committee  had  no  opportunity,  therefore,  to  work 
out  a  real  committee  report.  Mr.  Courtis,  however,  as  chairman,  deter- 
mined to  have  a  report,  so  he  wrote  one  himself.  This  he  presented  in  part  as 
the  first  number  on  the  afternoon  program.  While  certain  recommendations 
were  made  for  the  guidance  of  the  association  and  through  it  for  the  guidance 
of  research  workers  in  general,  the  paper  consisted  largely  of  the  presentation 
of  evidence  to  show  that  we  really  do  not  know  exactly  what  our  tests  mea- 
sure. As  an  indication  of  the  analysis  to  which  our  testing  instruments  must 
be  subjected,  the  paper  was  important. 

Dr.  Thorndike  was  to  have  presented  a  paper  on  "Intelligence  Tests  for 
College  Entrants."  He  was,  however,  unable  to  attend — and  again  we  have 
the  "flu"  to  thank  for  his  inability  to  respond.  Dr.  Thorndike  sent  his  paper 
but,  owing  to  the  shortened  program  consequent  upon  the  delay  in  getting 
started,  the  paper  was  not  read.  It  will  be  published  in  an  early  number  of 
the  Journal  of  Educational  Research. 

Mr.  Dickson — Dickson  all  the  way  from  the  Coast — gave  a  report  on  the 
use  of  intelligence  tests  in  the  classification  of  eighth  and  ninth-grade  pupils. 
He  demonstrated  the  reliability  of  these  tests  as  administrative  devices  for  the 
homogeneous  grouping  of  pupils  for  educational  guidance,  and  for  providing 
specialized  instruction  for  superior  children. 

Mrs.  Fleming  of  the  Wisconsin  State  Department  presented  her  paper  on 
"Reading  Ability  and  Intelligence."  Mrs.  Fleming  had  results  on  the  use  of 
the  Thorndike  reading  test  in  Wisconsin  and  Virginia.  From  the  Wisconsin 
results  she  is  tempted  to  conclude  that  there  is  a  close  correlation  between 
reading  ability  and  intelligence  but  the  Virginia  results  seemed  contrary. 
While  not  entirely  committing  herself,  she  seemed  to  feel  that  such  correla- 
tion did  exist  wherever  regular  school  attendance  and  emphasis  upon  reading 
were  generally  operative. 

Dean  Kelly  presented  ;a  study  of  "Three  Methods  of  Teaching  the 
Fundamentals  of  Arithmetic."  The  methods  were  by  use  of  (1)  Courtis 
Practice  Tests;  (2)  Studebaker  Practice  Tests;  (3)  Usual  teacher-devised 
drill  material.  The  results  were  definitely  favorable  to  scientifically  devised 
practice  material,  the  "Courtis"  getting,  in  general,  the  greatest  gains  for 
classes  but  the  "Studebaker"  evidencing  greater  corrective  effect. 

Mr.  Burgess,  one  of  our  new  members  in  the  Russell  Sage  Foundation, 
presented  "A  Trend  Analysis  of  Teachers'  Salaries."  By  a  study  of  the 
wages  of  skilled  and  unskilled  laborers  and  of  rural  and  city  teachers  during 
the  past  century  and  by  converting  the  wages  into  index  numbers,  he  showed 
the  following  facts:  (1)  wages  of  one  kind  follow  the  trend  of  wages  of  another 
kind  much  more  closely  than  they  do  the  cost  of  living,  (2)  wages  of  skilled 
and  unskilled  labor  respond  more  quickly  in  economic  crises  than  do  teachers' 
salaries,  (3)  rural  teachers'  salaries  and  wages  of  unskilled  labor  tend  to  be 
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nearly  equal  except  in  times  of  crisis,  (4)  city  teachers'  wages  tend  to  follow 
the  same  general  curves  as  those  of  rural  teachers  and  of  skilled  and  unskilled 
laborers;  but  they  lie  between  the  wages  of  the  last  named  groups,  (5)  times 
of  high  prices  show  a  decided  drop  in  the  index  of  teachers'  salaries. 

Mr.  Richardson  showed  some  results  attained  by  "The  Campaign 
Method  in  Elementary  Education"  with  special  reference  to  arithmetic  work 
in  the  four  fundamental  operations  with  whole  numbers.  The  method  con- 
sists of  taking  individual  results  directly  to  each  child  and  interesting  him  in 
making  a  record  for  himself.  Practice  examples  were  furnished  the  pupils. 
Although  the  campaign  was  carried  on  for  a  few  weeks  only,  results  showed 
large  and  permanent  gains. 

The  Fifth  Annual  Banquet  and  the  evening  program  were  the  climax  of 
the  week  to  the  members  of  our  association.  More  than  forty  members  and 
guests  were  present.  Serious  thought  and  kindly  humor  characterized  the 
evening  to  the  delight  of  all. 

Following  the  practice  of  the  past,  the  secretary  presented  one  name  for 
election  to  honorary  membership.  The  association  honored  itself  this  year 
by  electing  Dean  Wm.  F.  Russell  of  the  College  of  Education,  State  Univer- 
sity of  Iowa.  Dean  Russell  responded  to  the  election  with  a  striking  allegory, 
portraying  the  evolution  of  the  school  superintendent  in  terms  of  the  chauf- 
feur. 

Mr.  Packer  presented  very  briefly  the  need  of  a  definite  administration  of 
supervisory  work  through  a  department  of  research.  Such  a  plan  is  now  in 
operation  at  Detroit.  By  this  means,  he  said,  much  supervision  which  is 
ordinarily  wasted,  may  be  applied  where  it  is  most  needed.  His  plan  contem- 
plates the  fuller  recognition  of  the  building  principal  as  a  supervisor. 

Dr.  Rugg  spoke  on  the  necessity  of  scientificially  devised  text  books  as 
the  solution  of  much  of  the  present  school  inefl&ciency — a  solution  which  can 
be  applied  even  before  we  have  an  adequately  trained  body  of  teachers. 

The  first  annual  presidential  address  was  given,  summarizing  the  progress 
of  the  past  year  in  the  fields  of  particular  interest  to  our  membership.  The 
magnitude  of  this  progress  was  surprising  to  most  of  us. 

At  the  business  meeting,  the  following  oflScers  were  elected  for  1920-1921 : 
President,  M.  E.  Haggerty,  Director  of  Bureau  of  Co-operative  Research, 
University  of  Minnesota;  Vice-president,  Virgil  E.  Dickson,  Director  of 
Research  and  Guidance,  Oakland  and  Berkeley,  California;  Secretary- 
Treasurer,  E.  J.  Ashbaugh,  Director  of  Bureau  of  Educational  Service,  State 
University  of  Iowa,  Iowa  City,  Iowa. 

Much  of  the  business  so  far  as  discussion  was  concerned  had  been  con- 
ducted at  the  closed  session  on  Monday.  Accordingly  matters  were  disposed 
of  quickly.  In  addition  to  the  election  of  officers,  the  president  was  author- 
ized to  apf)oint  a  committee  with  power  to  act  in  the  matter  of  afiiliation  with 
the  National  Research  Council.  He  was  also  requested  to  appoint  a  perma- 
nent Standardization  Committee  and  a  committee  to  decide  the  day  of  the 
convention  week  on  which  our  closed  session  shall  hereafter  be  held.  Dues 
were  raised  from  $2 .  00  to  $3 .  00  beginning  with  1921. 


Editorial  Office,  Urbana,  Elinois  Editor-in-chief  B.  R.  Buckingham,  University  of  Illinob 
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INTELLIGENCE  EXAMINATIONS  FOR 
COLLEGE  ENTRANCE! 

Edward  L.  Thorndike 
Teachers  College,  Columbia  University 

For  an  ideal  examination  of  the  intelligence  of  candidates  for 
college  entrance  we  might  set  the  following  specifications : 
I.  Significance. — The  score  should  correlate  as  closely  with 
future  achievement  in  college  as  is  possible.  This  maxi- 
mum possible  correlation  will  not  be  LOO,  since  achieve- 
ment in  college  is  due  in  part  to  health,  to  freedom  from 
personal  worries,  and  to  various  moral  qualities  as  well  as 
to  intellect.  Also,  the  magnitude  of  the  correlation  co- 
efficient will  depend  on  the  range  of  the  intellect  of  candi- 
dates, being  smaller  as  that  range  is  restricted.  If  all  the 
eighteen-year-olds  in  the  country  were  educated  for  college, 
tested,  and  given  a  trial  in  college,  we  might  perhaps 
expect  a  maximum  correlation  as  high  as  0.75  to  0.85. 
Within  the  restricted  range  of  those  who  complete  a  high- 
school  course  and  actually  become  candidates,  we  may 
expect  as  a  maximum  0.55  to  0.65,  possibly  more.  A 
correlation  above  0.50  is  probably  an  improvement  over 
the  attainment  of  standard  systems  of  accrediting  high 
schools  or  of  entrance  to  college  by  examination  in  school 
subjects. 
11.  Continued  significance. — The  correlation  should  maintain 
itself  year  after  year  after  the  nature  of  the  intelligence 
examination  is  known  in  spite  of  whatever  coaching 
candidates  undertake.     This  implies,  in  theory,  that  such 

^  A  paper  prepared  for  presentation  before  the  National  Association  of  Directors 
of  Educational  Research  at  its  meeting  at  Cleveland,  Ohio,  February  26,  1920. 
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special  coaching  shall  give  training  that  is  nearly  as  useful  for 
future  college  achievement  as  for  success  in  the  test,  or  that 
the  tendency  to  undertake,  and  the  ability  to  profit  by 
such  special  coaching  shall  be  very  closely  correlated  with 
ability  to  achieve  in  college.  In  practice,  it  means  that 
the  examinations  year  after  year  should  be  totally  different 
in  content  until  a  great  many  of  them  are  available;  and 
should  differ  in  form  where  there  is  danger  that  adaptation 
to  the  form  of  the  examination  may  enable  a  dull  boy  to 
secure    a   good   score. 

III.  Comparability  of  standards  and  results. — (a)  The  examina- 

tions given  year  after  year  should  be  closely  equal  in 
difficulty;  (b)  the  scoring  should  be  by  standard  keys  so 
that  the  same  paper  scored  by  different  examiners  will 
receive  substantially  the  same  score;  (c)  the  administra- 
tion of  the  examination  should  be  simple  and  independent 
of  the  personality  of  the  examiner. 

IV.  Probable  error  of  the  examination  itself. — For  the  examina- 

tion's main  purpose,  the  probable  error  is  already  taken 
account  of  in  the  correlations  with  college  success.     For 
that  purpose,  in  fact,  a  large  probable  error  would  be 
encouraging,  for  it  would  mean  that  by  repeating  the 
examination,  using  a  different  form,  the  correlation  with 
college  success  could  be  notably  raised.    For  certain  special 
purposes  such  as  comparing  individuals  or  groups,  and  for 
the  justification  of  shortened  forms  of  the  examination,  the 
smaller  the  probable  error  the  better. 
A  half-year's  experience  with  the  Thorndike  IntelHgence  Exam- 
ination for  High  School  Graduates  may  increase  our  confidence 
that  these  specifications  may  be  met  to  a  rather  close  approxima- 
tion.    This  examination  was  devised  at  the  request  of  the  faculty 
of  Columbia  College,  where  it  is  an  optional  means  of  entrance  for 
boys  suitably  recommended.     Three  forms  of  it  have  been  used  to 
date  by  Columbia,  one  in  June  1919,  one  in  September  1919,  and 
one  in  February  1920.     About  seven  hundred  candidates  have 
taken  it,  though  over  half  of  these  were  already  legally  admitted 
by  the  content  examinations  of    Columbia   University   or   the 
College  Entrance  Examination  Board  or  the  New  York  Regents. 
It  has  also  been  used  for  various  purposes  by  a  number  of  other 
institutions. 
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Significance 

Four  years  must  elapse  before  an  exact  accounting  on  this 
point  can  be  made,  but  the  following  facts  may  be  noted : 

Of  eleven  boys  at  Columbia,  reported  to  the  dean's  office  for 
inability  to  do  college  work  in  the  early  weeks  of  the  year,  all  had 
notably  low  scores  in  the  intelligence  examination.  Of  a  score  or 
more  so  reported  as  a  result  of  the  mid-term  records,  all  but  two 
had  low  scores.  The  defective  college  work  of  these  two  was  by 
common  consent  not  due  to  intellectual  defect. 

In  the  case  of  a  group  of  eighty  odd  candidates  in  another 
college,  the  correlation  between  the  score  in  the  Thorndike 
examination  and  the  first  term's  college  record  was  over  0.65. 
The  highest  40  percent  in  the  examination  showed  74  percent  of 
high  grades  in  college  work  and  26  percent  of  low  grades.  The 
lowest  60  percent  in  the  examination  showed  27  percent  of  high 
grades  and  73  percent  of  low  grades.  Of  the  16  percent  receiving 
the  lowest  grades  in  the  examination,  none  received  any  college 
grade  above  C  and  86  percent  failed  in  five  hours  or  more  of  their 
college    work 

In  a  third  institution,  where  the  entire  student  body  was  tested, 
the  members  of  the  three  upper  classes  showed  no  scores  below  60 
in  the  examination,  whereas  a  third  of  the  freshmen  (admitted  by 
certificate)  scored  below  60.  The  distributions  given  in  the 
accompanying  table  (Table  I)  give  a  correlation  of  approximately 
0.55  between  test  score  and  continuance  beyond  the  freshman  year. 
The  returns  received  from  the  first  and  third  of  these  institutions 
are  a  random  selection  from  trials  of  the  examination.  Those 
from  the  second  institution  were  reported  to  the  writer.  They 
may  have  been  reported  because  of  the  positive  evidence  of  the 
success  of  the  examination,  and  so  may  be  unduly  favorable. 

Continued  Significance 

If  we  take  the  best  of  the  test  material  that  has  demonstrated 
high  correlations,  such  as  selected  series  of  opposites,  mixed  rela- 
tions, and  cleverly  devised  problems  and  completions,  and  give  it 
without  fore-exercise,  we  can  undoubtedly  get  high  correlations, 
but  we  may  be  unable  to  maintain  them. 

Our  opposites,  relations,  and  problems  of  later  years  will  prob- 
ably not  be  so  ingenious  as  those  which  we  chose  first.  Moreover, 
part  of  the  first  high  correlation  may  have  been  due  to  the  testing 
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TABLE    I.      THE    SCORES,    IN    PERCENTAGES,     OF    STUDENTS    IN 
A  WESTERN  PROFESSIONAL  SCHOOL  IN  THE  THORNDIKE 
INTELLIGENCE  EXAMINATION  FOR  HIGH 
SCHOOL  GRADUATES 

(This  institution  admits  on  certificate  from  accredited  schools  but  finds 
that  a  considerable  percentage  of  the  students  so  admitted  do  not  satisfy  its 
standards,  the  elimination  being  rather  large.  The  figures  below  show  that 
apparently  an  ability  denoted  by  a  score  of  60  or  more  in  the  Thomdike 
examination  is  required  for  meeting  the  standards  of  this  institution.  None 
of  the  sophomores,  juniors,  and  seniors  fall  below  60,  whereas  about  one-third 
of  the  freshmen  do.) 


Score  in 

Sophomore 

Thomdike 

[  Freshmen 

Junior 

Examination 

Percent 

Senior 
Percent 

30 

2.6 

2.6 

12.9 

2.6 

2.6 

10.3 

15.4 

35 

40 

45 

50 

55 

60 

5.5 

65 

10.3 

16.3 

70 

12.9 

10.9 

75 

5.1 

8.1 

80 

7.7 

19.0 

85 

10.3 

10.9 

90 

7.7 

8.1 

95 

10.9 

100 

8.1 

105 

0 

110 

0 

115 

2.7 

of  ability  to  understand  quickly  the  nature  of  the  tasks.  When 
the  nature  of  the  examination  becomes  a  matter  of  public  knowl- 
edge to  candidates,  the  best  features  of  it  may  be  lost.  It  will  be 
specially  disastrous  if  some  candidates  do  and  others  do  not  know 
about  it. 

Consequently,  thorough  precautions  must  be  taken  so  that  the 
examination  will  be  as  effective  for  twenty  years  as  it  is  in  its  first 
trials.     Our  precautions  are: 
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1.  All  test  material  is  made  up  in  quantities  sufficient  to  pro- 
vide for  the  entire  series  of  examinations  into  which  it  enters,  and 
is  distributed  without  prejudice  among  them.^  The  selection  for 
September  1929  will  be  nowise  inferior  to  the  selection  for  Sep- 
tember 1919. 

2.  Three-fourths  of  the  candidates'  time  is  spent  on  paragraph 
reading,  completing  sentences,  tests  of  information,  arithmetical 
and  algebraic  computations  and  problem  solving,  common-sense 
questions,  and  following  directions.  The  nature  of  these  tasks  is 
understood  in  a  second  or  two  by  everybody  of  the  intelligence 
level  of  a  high-school  graduate.  In  examining  hundreds  of  papers, 
I  have  never  seen  a  case  of  misunderstanding  a  single  one  of  these 
tasks. 

3.  With  two  exceptions,'  fore-exercise  is  given  for  the  other 
tasks,  and  two  trials  at  each  task  are  allowed.  They  include  such 
tests  as  the  disarranged  sentences,  opposites,  number-series  com- 
pletions, verbal  analogies,  pictorial  analogies,  geometrical  rela- 
tions, and  absurdities.  The  nature  of  these  is,  in  general,  such 
that  any  unfair  advantage  to  a  boy  whom  some  unscrupulous 
tutor  might  train  in  test-taking  would  be  slight.  Experiments 
are  planned  to  measure  this  gain  exactly.  If  it  is  appreciable,  the 
examination  will  be  extended  to  include  "traps'*  to  penalize  such 
improper  preparation, 

4.  The  content  of  the  examination  is  entirely  different  in  each 
issue.  The  form  of  the  examination  in  the  case  of  those  tests 
where  an  unfair  advantage  from  coaching  is  a  possibility,  will 
change  every  two  or  three  years. 

5.  Finally,  no  new  issue  will  be  used  regularly  until  it  has  been 
tried  out  sufficiently  to  insure  its  giving  a  prophecy  substantially 
equivalent  to  the  previous  issues  of  the  examination. 

Comparability  of  Standards  and  Results 

Since  each  element  of  the  examination  is  selected  at  random 

as  to  difficulty,  the  total  examination,  comprising  over  twenty 

different  tests,  will  in  any  one  issue  of  the  same  general  type,  be 

closely  equal  in  difficulty  to  any  other  (with  the  exception  of  the 

^  This  is  not  true  of  the  June  1919  series,  which  had  to  be  arranged  in  part  before 
the  total  material  could  be  planned. 

^  In  the^  later  series  it  is  planned  to  provide  fore-exercise  for  these,  if  any  evidence 
appears  that  it  is  needed  to  equalize  matters  for  those  who  have  and  those  who  have 
not  previous  acquaintance  with  the  examination. 
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June,  1919  series  which,  for  the  reason  given  above,  could  not  be 
fully  standardized  and  is  in  part  somewhat  harder  than  the 
others).  Each  issue  is  further  checked  in  this  regard  by  actual 
trial.     For  example: 

Eighty  college  students  took  Forms  A  and  F,  Part  I,  of  the  ex- 
amination in  that  order.  Eighty  others  took  Forms  A  and  G  in 
that  order.  Letting  a = score  in  A,  f= score  in  F,  and  so  on,  we 
find  that  Median  of  (f— a)  =  Median  of  (g— a)  +  l.  That  is, 
Form  G  is  1  point,  or  less  than  1%,  harder  than  Form  F. 

Thirty-six  college  students  took  Forms  A  and  H  in  that  order. 
Median  of  (h— a)  =  Median  of  (f— a)-l-l3^.  That  is.  Form  F  is 
13^  points,  or  a  little  over  1%,  harder  than  Form  H. 

One  hundred  fifty-four  college  students  took  Forms  A  and  J  in 
that  order.  Median  of  (j— a)  =  Median  of  (f— a)-i-2.  That  is, 
Form  F  is  2  points,  or  about  i3i%  harder  than  Form  J. 

Thus  f=g-|-l  =  h-l3^=j-2 

Part  II  Form  B  and  Part  II  Form  C  were  each  given  to  85 
college  students,  the  two  groups  of  85  being  random  halves  of  a 
group  of  170.  The  two  groups  were  tested  at  the  same  time  in  the 
same  room,  by  the  same  examiner,  all  instructions  being  identical. 
The  median  score  for  Form  B  was  81.5;  for  Form  C,  79.0  or  a 
difference  of  2.5.  The  2 5 -percentile  score  for  Form  B  was  58.3; 
for  Form  C  57.5  or  a  difference  of  —0.8.  The  7 5 -percentile  score 
for  Form  B  was  102.7;  for  Form  C  101.9  or  a  difference  of 
—  0.8.     In  general,  the  two  distributions  are  closely  similar. 

We  may,  therefore,  conclude  that  Part  II  C  is  probably  a  trifle 
harder  than  Part  II  B  (about  13^  percent).* 

Thirty-three  college  students  took  both  III  B  and  III  C,  sixteen 
having  one  form  first  and  seventeen  having  the  other  form  first. 
The  median  of  (c— b)  =  l3^  points  or  about  23^  percent. 

Two  examinations  made  up  respectively  of: 

I  G  I  J  II  B  and  III  B 

IF  I  H  II  C  and  III  C 

would  thus  be  almost  exactly  equal  in  difficulty  for  a  college  group. 

Twenty- three  adults  took  both  II  B  and  II  D,  twelve  having 
Form  B  first  and  eleven  having  Form  D  first.  The  median  of 
(b— d)  =  4.     That  is,  Form  D  is  4  points  harder  than  Form  B. 

*  Test  7  was  omitted  in  both  cases,  but  we  know  from  other  evidence  that  II  B  7 
and  II  C  7  are  very  closely  similar  in  difficulty. 
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So,  when  II  D  is  used  in  place  of  II B  or  II  C,  the  other  parts  of  the 
examination  should  be  chosen  to  be  a  trifle  easier  than  I  G,  I  J, 
III  B,  or  I  F,  I  H,  III  C. 

The  difference  in  difficulty  between  any  two  issues  can  thus  be 
known  and  allowed  for  by  transmuting  the  score,  or,  if  it  is  at  all 
large,  it  can  be  reduced  by  alterations  in  the  examination  and  re- 
checking.  This  process  of  equalization  can  be  applied  to  the 
10-percentile  or  20-percentile  or  any  other  ability  levels  as  well  as 
to  the  general  tendency  of  the  group. 

This  checking  is  extremely  laborious  and  probably  unnecessary, 
since  differences  of  3  and  4  or  even  of  5  and  6  percent 
in  the  difl5culty  of  different  issues  are  of  little  practical  conse- 
quence in  any  uses  to  which  the  examination  is  likely  to  be  put. 
However,  their  reduction  to  small  amounts  and  an  exact  knowl- 
edge of  these  amounts  make  an  instrument  available  for  very 
precise  comparisons. 

The  scoring  of  all  save  the  reading  and  completion  tests  is, 
with  very  slight  exceptions,  done  by  absolute  keys  with  no  re- 
quirement of  judgment  on  the  part  of  the  scorer.  The  scoring  of 
the  reading  and  completion  tests  requires  some  judgment  in  the 
use  of  the  keys,  but  the  correlation  between  the  ratings  given  by 
two  scorers  of  the  ability  of  a  college  instructor  or  assistant  is 
very  high.  The  correlation  between  two  such  scorers  is  0.98. 
The  probable  difference  between  two  such  scorers  was  found  to  be 
only  five  points  out  of  a  total  score  which  ranges  from  7  to  96 
among  the  actual  candidates  whose  papers  were  scored.  These 
scorers  used  only  the  stock  keys  supplied  with  the  tests.  By 
having  one  person  score  one  test  of  the  six,  another  score  another, 
and  so  on,  the  probable  error  for  the  total  result  of  one  such  group 
of  six  would  obviously  be  unappreciable.  This  is  the  practice  rec- 
ommended where  the  examination  is  used  with  groups  of  any  con- 
siderable size. 

The  administration  of  the  examination  consists  simply  of  giving 
out  the  blanks,  and  instructing  the  candidates  to  go  ahead  at 
certain  times  even  if  they  have  not  finished  the  work  to  date.  In 
general,  a  candidate  does  test  after  test  without  awaiting  instruc- 
tions. 

Improvement  of  the  Examination 

As  soon  as  adequate  records  of  success  in  college  are  available, 
the  correlation  of  each  element  of  the  examination  therewith  will 
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be  computed  together  with  the  partial  correlations  where  these  are 
instructive.  In  the  meantime,  data  are  being  gathered  concern- 
ing the  value  of  different  available  tests  as  shown  by  their  cor- 
relations with  a  composite  score  obtained  in  seven  or  eight  hours 
of  work  by  adults  of  the  general  intelligence  level  of  college 
candidates.  Some  of  the  data  so  far  obtained  are  of  value  to 
anybody  who  is  working  with  group  tests  for  adult  intelligence, 
and  are  presented  here.  Lack  of  space  forbids  adequate  descrip- 
tion of  the  tests.  The  following  definitions  apply  to  captions 
appearing  in  Tables  II  and  III. 

1.  "Part  I  (first  half)"  means  the  first  30  minutes  work  of  the 

standard  examination  as  now  given. 

2.  "Part  II"  means  Part  II  of  the  standard  examination. 

3.  "Part  III"  means  Part  III  of  the  standard  examination. 

4.  "New  Part  I  (first  half)"  means  a  new  form  of  Part  I  to  go 

into  effect  in  1922. 

5.  "Information"  means  a  test  of  the  type  used  in  the  Army 

Alpha,  but  harder. 

6.  "Name  part"  means  a  test  in  writing  a  word  that  means  a 

part  of  the  thing  named  by  the  given  word,  and  also  begins 
with  a  certain  letter. 

7.  "Name  opposite"  means  a  test  in  writing  a  word  that  means 

the  opposite  of  the  given  word,  and  also  begins  with  a 
certain  letter. 

8.  "Name  thing  of  which  is  part"  means  a  test  in  writing  a  word 

meaning  something  of  which  the  thing  named  by  the  given 
word  is  a  part.  The  word  written  must  also  begin  with 
a  certain  letter. 

9.  "Name  thing  made  of,"  "synonyms"  and  "species  of  genus" 

are  like  the  above.  The  word  written  has  to  fulfill  the  re- 
quirement of  being  in  the  stated  relation  to  the  given  word 
and  also  of  beginning  with  a  certain  letter. 
10.  "Sum,  difference,  product"  means  a  test  in  giving  two 
numbers  which  are  defined  by  certain  relations  (e.g.  two 
numbers  whose  product  is  1  and  whose  sum  is  2). 
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TABLE    II.      CORRELATIONS    OF    VARIOUS    FORMS    OF    GROUP    TESTS 
OF  ADULT  INTELLIGENCE  LEVEL  WITH  A  COMPOSITE 
SCORE  FOR  SEVEN  HOURS  OF  TEST  WORK,  IN 
THE  CASE  OF  ZS  COLLEGE  STUDENTS 


Test 


Time  in 
Minutes 


Correlation 


Part  I  (first  half) 

Part  II 

Part  III 

Part  III 

New  Part  I  (first  half) 

Information 

Name  part 

Name  opposite 

Name  thing  of  which  is  part 

Name  thing  made  of 

S5Tionyms 

Species  of  genus 

Sum,  difiference,  product . . . , 

Total  Time 


30 
60 
40 
120 
30 
15 
8 
12 
13 

13^ 
16 

123^ 
20 


0.75 
0.85 
0.65 
0.81 
0.84 
0.62 
0.40 
0.80 
0.72 
0.61 
0.66 
0.61 
0.83 
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TABLE    III.      INTERCORRELATIONS    OF    VARIOUS    FORMS    OF    GROUP 

TESTS  FOR  ADULT  INTELLIGENCE  LEVELS 

33  COLLEGE  STUDENTS 


Name 
Part 

Name 
Opposite 

Thing 

of 

Which  Is 

Part 

Thing 

Made 

of 

Synonyms 

Species 

of 
Genus 

Information 

Name  part 

0.03 

0.56 
0.25 

0.53 
0.27 
0.61 

0.54 
0.30 
0.46 
0.49 

0.48 
0.30 
0.83 
0.64 
0.49 

0.52 
0.33 

Name  opposite 

0.49 

Thing  of  which  part 

0.39 

Thing  made  of 

0.55 

Synonyms 

0.21 

Facts  like  those  shown  in  Tables  II  and  III  are  being  collected 
from  individuals  of  the  intelligence  level  of  college  students  as 
fast  as  time  and  facilities  permit,  so  that  no  test  need  ever  be 
used  in  the  examination  until  its  value  has  been  demonstrated. 


A  NEW  METHOD  OF  RATING  TEACHERS 

William  L.  Connor^ 

Superintendent  of  Schools,  Republic,  Michigan 

It  is  the  teacher's  task  to  make  changes  for  the  better  in  the 
abilities,  habits,  and  attitudes  of  boys  and  girls.  Her  efficiency- 
can  be  evaluated  fairly  only  in  terms  of  her  success  at  this  task. 
In  other  words,  if  a  teacher  is  rated  at  all,  she  should  be  rated,  not 
by  the  clothes  she  wears,  or  the  method  she  chooses,  but  by  the 
results  she  secures. 

The  rating  card  here  proposed,  together  with  the  lists  of 
"concrete  acts"  and  suggestions  for  use,  constitutes  a  scheme  for 
rating  teachers  according  to  the  results  they  secure  with  boys 
and  girls.  It  is  not  a  perfect  plan;  but  it  has  proved  more  satis- 
factory to  teachers  than  the  usual  type  of  rating  scheme  in  which 
personal  qualities,  training,  discipline,  attention  to  equipment, 
etc.,  take  equal  rank  with  the  results  secured.  The  studies  re- 
ported in  this  paper  were  made  by  persons  in  both  supervisory 
and  teaching  positions,  who  were  trying  to  make  a  "promotion  by 
merit"  scheme  work.  They  believe  they  have  evolved  a  way  of 
rating  the  efficiency  of  teaching  which  is  better  than  any  scheme 
in  common  use,  but  realize  it  is  still  vastly  short  of  the  "dream  of 
the  scientist  in  education"  of  which  Cofifman  speaks  r^  a  scale  for 
measuring  the  efficiency  of  teaching. 

The  stimulus  to  the  evolution  of  the  new  rating  scheme  was 
the  adoption  by  the  board  of  education  of  Republic,  in  the  fall  of 
1916,  of  a  resolution  creating  a  uniform  basal  salary  of  $550.00  a 
year  for  the  grades  and  $750.00  for  the  high  school,  and  also 
empowering  the  superintendent  to  rate  the  efficiency  of  each 
teacher  as  a  basis  for  determining  additional  compensation  rang- 
ing from  $25.00  to  $75.00  a  year.  These  figures  were  later 
increased  to  $650.00  and  $850.00  per  year  and  the  range  of  the 
bonuses  from  $50.00  to  $150.00. 

^  The  author  appreciates  and  desires  to  acknowledge  the  assistance  given  by 
teachers,  and  others  including  the  editors,  of  the  Journal  of  Educational  Re- 
search in  the  preparation  of  this  study. 

'  Coffman,  L.  D.  "The  rating  of  teachers  in  service,"  School  Review  Monograph, 
No.  5,  p.  14  ff.,  1914. 
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Only  a  short  time  before,  the  scheme  of  paying  labor  according 
to  the  product  had  been  adopted  in  the  mines  about  Republic. 
The  "bonus  for  merit"  plan  was  thus  readily  comprehended  by 
the  board  of  education  and  adopted  as  a  means  of  meeting  the 
teacher  situation.  The  details  of  the  plan  for  distributing  the 
additional  compensation  for  merit  were  left  to  the  superintendent 
to  devise.  As  at  first  proposed  and  adopted,  it  was  in  general 
as  follows:  Teachers  were  to  be  rated  by  the  superintendent  and 
divided  into  five  classes,  namely,  inferior,  below  average,  average, 
above  average,  and  superior.  Teachers  in  the  two  lowest  classes 
were  not  to  receive  any  extra  compensation,  the  others  $25.00, 
$50.00,  and  $75.00  in  order  of  merit.  Later  these  bonuses  were 
increased  to  $50.00,  $100.00,  and  $150.00  a  year. 

The  first  simple  rating  scheme  was  composed  of  material  from 
the  studies  of  Ruediger  and  Strayer,'  Elliott,*  Boyce,^  and  others, 
and  was  used  for  the  first  time  in  January,  1917.  Cubberley  had 
only  recently  written  that  some  such  plan  was  the  most  important 
means  of  stimulating  and  rewarding  professional  growth  and 
efl&ciency.  At  the  same  time,  he  had  warned  that  it  was  the 
hardest  plan  to  put  into  successful  operation.  Other  school  men 
whose  opinions  the  writer  valued  asked  him,  some  jocosely,  some 
seriously,  if  he  expected  to  weather  the  storm  raised  by  the  first 
ratings.  It  was,  then,  with  mingled  hopes  and  misgivings  that 
the  plan  was  presented  to  teachers  for  their  consideration  and 
criticism. 

During  the  period  when  the  details  of  the  plan  were  being 
worked  out,  the  teachers  were  being  invited  to  examine  the  plan 
and  were  generally  brought  to  approve  its  logic.  At  the  same 
time  they  were  warned  that  the  rating  scheme  proposed  for  use 
was  very  imperfect  and  that  the  superintendent  might  make  mis- 
takes however  just  he  might  try  to  be.  The  immediate  increase 
of  $50.00  a  year  to  over  half  the  teachers,  together  with  the  pro- 
spective increases  for  merit,  tended  to  stay  criticism  for  a  while. 
This  time  was  used  in  getting  the  teachers  ready  to  attack  the 

» Ruediger,  W.  C,  and  Strayer,  G.  D.  "The  qualities  of  merit  in  teachers,"  Journal 
of  Educational  Psychology,  Vlll-I^,  May,  1910. 

*  Elliott,  E.  C.  "How  shall  the  merit  of  teachers  be  tested  and  recorded,"  Educa- 
Pional  Administration  and  Supervision,  1:291-99,  May,  1915. 

•  Boyce,  A.  C.  "Methods  for  measuring  teachers'  efficiency,"  Fourteenth  Yearbook 
of  the  National  Society  for  the  Study  of  Education,  1915,  Part  II,  p.  10. 
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rating  scheme,  instead  of  the  superintendent  or  the  logic  of  the 
plan,  when  in  due  time  they  should  become  critical.  Little  by- 
little  they  were  brought  to  feel  that  they  were  about  to  cooperate 
in  doing  two  of  the  hardest  and  most  worthwhile  things  in  educa- 
tion; namely,  working  out  a  satisfactory  scheme  for  rating  the 
quality  of  teaching,  and  using  the  scheme  in  determining  a  part 
of  the  pay  of  teachers. 

The  first  formal  ratings  were  passed  out  in  January,  1917. 
The  superintendent  found  no  superior  teachers  and  only  one 
inferior  teacher.  About  one-fourth  of  the  force  was  rated  above 
average,  one-half  average,  and  one-fourth  below  average  and 
inferior  together.  Bonuses  were  paid  for  the  first  half  of  the 
year.  Three-fourths  of  the  teachers  received  checks  for  $12.50 
or  $25,00  with  their  first  ratings.  The  expected  criticisms  ap- 
peared at  once,  but  the  lines  for  it  to  follow  had  been  well  enough 
drawn  to  confine  it  largely  to  really  helpful  suggestions  for  revising 
the  rating  scheme. 

After  the  first  general  rating,  the  teachers  became  intelligently 
critical  and  cooperated  actively  in  revising  the  method  of  rating 
used.  Various  schemes  were  tried  which  need  not  be  described 
here.  One  involved  an  attempt  to  make  standard  definitions  of 
merit. 

A  small  group  of  superintendents  and  an  equal  number  each 
of  principals,  supervisors,  and  very  capable  teachers  were  asked 
to  choose,  from  among  the  teachers  of  their  acquaintance,  one 
representative  of  each  of  the  five  classes  proposed  here,  namely, 
inferior,  below  average,  average,  above  average,  superior;  and, 
then,  to  describe  at  work  the  teachers  thus  chosen  to  represent 
the  several  classes,  or  merit-groups,  using  the  "First  Rating 
Scheme  Devised  on  a  Cooperative  Basis,  1917"  as  an  outline  for 
the  description  (Figure  1).  Quite  naturally  the  scheme  fell 
through.  We  could  not  persuade  our  friends  literally  to  write  a 
book  for  us  in  their  spare  time.  Gradually,  the  conviction  grew 
in  the  minds  of  the  teachers  and  the  superintendent  that  the 
scheme  gave  too  much  credit  to  items  only  remotely  related  to 
the  real  business  of  the  school,  namely,  making  changes  for  the 
better  in  the  behavior  of  boys  and  girls.  Here  I  use  behavior  in 
the  sense  of  all  significant  mental  and  physical  responses  to  all 
situations. 
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FIGURE  1.     FIRST  RATING  SCHEME  DEVISED  ON  A  COOPERATIVE 

BASIS,  1917 

Teacher Grade  or  subject 

School Address Date 19 

The  Teacher  and  Her  Work 
I.     The  teacher 5  4321 

A.  Personal  appearance 5  4  3  2  1 

B.  Character 5  4  3  2  1 

C.  Education 5  4  3  2  1 

D.  Social  efficiency 5  4  3  2  1 

II.    The  government  of  the  school 5  4  3  2  1 

A.  Assignments 5  4  3  2  1 

B.  Morale  in  the  despatch  of  assignments  5  4  3  2  1 

C.  Freedom  to  initiate  social  activities. . .   5  4  3  2  1 

D.  Elimination  of  anti-social  conduct. ...   54321 

III,  Instruction  as  providing  for  educative  activities 5  4321 

A.  Thinking 5  4  3  2  1 

B.  Emotional  reaction 5  4  3  2  1 

C.  Acquisition  of  knowledge  and  skill. ...  5  4  3  2  1 
*D.  Deportment 5  4321 

IV.  The  teacher's  attention  to 5  4  3  2  1 

A.  Health  and  comfort  of  pupils 543  2  1 

B.  Play  and  social  life  of  pupils 543  2  1 

C.  Grounds,  buildings,  equipment  &  sup- 

plies   5  4  3  2  1 

*D.  Professional  ethics 5  4  3  2  1 

Note:  Qualities  are  designated  thus: — superior,  1;  above  average,  2; 
average,  3;  below  average,  4;  inferior,  5. 

*  These  two  items  were  added  during  1917-1918. 

While  in  this  state  of  mind,  the  author  listened  to  an  address 
given  before  the  Atlantic  City  meeting  of  the  National  Associa- 
tion of  Directors  of  Educational  Research  in  which  Assistant 
Superintendent  Allison  of  Chicago  stated,  by  way  of  illustrating 
a  point  about  the  Boyce  score  card,  that  it  was  his  belief  that  the 
correlation  between  personal  appearance  and  teaching  ability 
was  zero  or  actually  negative.*  Another  man  at  the  same  meeting 
wittily  remarked:  "The  homely  girls  make  the  principles  work, 
while  the  pretty  ones  work  the  principals — p-I-e-s  and  p-a-l-s, 
please  note."     Only  recently  Morton's^  study  reveals  much  the 

*  Bulletin  No.  1  of  the  Board  of  Education  of  Chicago,  November  23,  1917,  con- 
tains much  of  the  material  used  by  Mr.  Allison  in  this  address. 

^  Morton,  R.  L.,  "Qualities  of  merit  in  secondary  teachers,"  Educational  Adminis- 
tration and  Supervision,  5 :225-38,  May- June,  1919. 
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same  general  state  of  affairs.  He  says  in  one  place:  "Evidently, 
then,  in  the  judgment  of  the  inspector,  a  desirable  reaction  on  the 
part  of  the  pupils  cannot  (certainly)  be  secured  by  a  teacher  whose 
personality  and  scholarship  are  ideal,  whose  methods  are  above 
reproach,  and  who  teaches  in  a  room  where  the  physical  factors 
are  as  they  should  be."  In  the  judgment  of  the  writer,  a  per- 
fectly groomed  teacher  of  perfect  physical  proportions  working 
with  perfectly  graded  children  in  a  perfect  physical  environment 
may  and  often  does,  use  perfectly  good  methods  in  a  perfectly 
futile  way. 

This  rather  sweeping  conclusion  was  pretty  generally  reached 
by  teachers  in  Republic  in  March,  1918,  and  it  was  very  soon 
afterward  that  they  adopted  certain  guiding  principles  for  their 
further  study  of  rating  teachers.  These  principles,  briefly  stated, 
are  as  follows: 

1.  Teaching,  not  teachers,  should  be  rated. 

2.  Teaching  is  measurable  in  terms  of  the  results  only. 

3.  Results  may  be  classified  as  inferior,  below  average,  average, 
above  average,  or  superior,  only  with  reference  to  the  amount 
of  improvement  made  and  the  ability  of  the  particular  group  of 
boys  and  girls  to  improve. 

Once  these  principles  are  accepted,  four  general  problems 
present  themselves  for  solution.     They  are  as  follows: 

1.  Determination  of  a  few  general  headings  under  which  all 
the  items  of  behavior  the  school  desires  to  affect  favorably  through 
the  agency  of  the  classroom  teacher  can  be  grouped. 

2.  Evaluation  of  these  headings,  or  groups  of  items  of  behavior, 
in  the  desired  result. 

3.  Choice,  from  existing  scales,  of  those  which  measure  prog- 
ress along  the  lines  desired,  and  the  creation  of  new  scales  needed, 
or  other  means  of  making  rough  estimates  of  progress  along  lines 
where  scales  are  yet  far  off. 

4.  Determination  of  how  much  progress  any  particular  group 
assigned  to  any  classroom  teacher  ought  to  make. 

The  scheme  for  rendering  standards  fairly  intelligible,  which 
was  finally  decided  upon  as  the  only  feasible  one  for  Republic, 
was  this: 

1.  All  items  on  the  rating  card  were  defined  in  general  terms, 
with  reference  to  the  dictionary. 
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2.  Items  were  redefined  in  terms  of  the  standards  thought 
to  be  desirable  in  education. 

3.  As]  many  concrete  acts  and  conditions  of  teachers,  teaching, 
pupils,  schoolrooms,  etc.,  as  could  be  collected  by  the  superin- 
tendent and  the  cooperating  teachers  were  typewritten  and  made 
available  for  use  in  supervision.  This  material  grew  rapidly 
from  a  few  pages  to  more  than  a  hundred. 

The  seven  elements  or  standards  by  which  teachers  were  to 
be  rated  were  mimeographed  on  separate  slips  of  paper  and  dis- 
tributed, with  appropriate  explanations  and  directions  to  those 
taking  part  in  the  experiment. 

STANDARDS 
I.  Thinking 

General  definition:  Mental  activity  in  the  course  of  which  the  mind 
locates  a  difficulty,  and  in  the  process  of  solving  the  difficulty  arrives  at  a 
conclusion  which  is,  to  it,  a  new  meaning,  belief,  act  or  way  of  thinking,  or 
any  combination  of  these.  Definition  of  standard:  Thinking  by  pupils  in 
study  or  recitation,  and  test  of  the  quality  and  amount  agreed  upon  and 
set  down  in  the  course  of  study  or  other  practice  standards. 
II.  Emotional  Reaction 

General  definition:  Feelings,  and  actions  growing  out  of  feelings.  Defini- 
tion of  standard:  Appreciation  resulting  in  immediate  pleasure,  and  emotion 
leading  to  action  which  is  of  individual  and  social  value. 
III.  Knowledge  and  Skill 

General  definition:  Information  and  practical  efficiency  in  doing.  Defini- 
tion of  standard:  Classroom  practices  and  results  as  to  knowledge  and  skill 
as  set  down  in  the  course  of  study  and  other  practice  standards.  (A  course  of 
study  in  which  standards  of  procedure  and  results  as  to  knowledge  and  skill 
required  are  not  determined  by  objective  measurement  of  both  needs  and 
results,  in  so  far  as  that  is  possible  today,  is  hardly  to  be  defended.) 
IV.  Morale  in  Despatch  of  Work 

General  definition:  Confidence,  courage,  loyalty,  self-reliance,  prompt- 
ness, and  persistence  with  which  work  is  performed.  Definition  of  standard: 
Confident,  courageous,  loyal,  self-reliant,  prompt,  and  persistent  spirit  of 
pupils  at  work. 

V.  Initiative  in  Socially  Significant  Situations 

General  definition:  Ability  and  will  to  propose  or  choose,  lay  out,  and 
carry  forward  work  furthering  the  purpose  of  the  individual  and  the  group. 
Definition  of  standard:  Pupils  proposing  or  choosing,  organizing,  and  carrying 
forward  work  furthering  the  educative  purpose  of  school  groups. 

VI.  ETincAL  Self-Control  in  Situations  Socially  Significant 

General  definition:  Inhibition  of  actions  which  would  interfere  with 
carrying  forward  the  purposes  of  social  groups.     Definition  of  standard: 
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Inhibition  in  the  classroom,  and  other  group-units  of  the  school,  of  conduct 
interfering  with  carrying  forward  educative  activity. 

VII.  Deportment 
General  definition:  The  manner,  bearing,  or  style  of  a  person  in  doing 
things.    Definition  of  standard:  Easy,  natural,  graceful,  and  courteous  use  of 
correct  form  in  doing  things. 

INSTRUCTIONS  ACCOMPANYING  THE  STANDARDS 

Thinking  Straight 
All  of  you  who  arrange  these  standards  want  to  express  your  best  judg- 
ment of  the  relative  values  of  the  standards.  In  order  to  do  this,  avoid 
thinking  of  the  time  order  in  which  you  may  have  been  taught  to  believe  these 
standards  are  acquired  by  boys  and  girls.  Think  rather  of  the  concrete 
acts  making  up  each  standard  as  being  considerably  different  at  different 
ages.  More  concretely,  think  of  the  group  of  boys  and  girls  you  teach  as 
possessed,  and  not  possessed,  alternately,  of  the  attitudes,  abilities,  and 
habits  implied  in  each  standard,  and  ask  yourself:  "In  what  order  of  impor- 
tance would  I  place  the  possession  of  these  standards  by  my  boys  and  girls? 
How  would  I  emphasize  their  acquisition  by  the  pupils  under  my  charge  if  I 
felt  a  deep  responsibility  to  each  individual  in  my  group,  and  to  society  as  a 
whole,  and  knew  my  efforts  this  year  were  to  be  the  last  conscious  educative 
efforts  to  be  expended  on  a  majority  of  these  boys  and  girls  for  the  rest  of 
their  lives?"  But  do  not  rate  any  proposed  standard  low  because  you  do  not 
now  know  how  to  get  pupils  to  acquire  it.  Rate  the  standard  according 
to  its  importance  or  desirability,  and  face  squarely  the  issue  of  finding  new 
subject-matter  or  methods  by  which  the  standard  may  be  realized.  In  this 
concrete  fashion,  test  and  re-test  your  arrangement  of  the  standards. 
Final  Directions  for  Arranging  the  Standards 

1 .  Read  the  seven  standards  critically,  trying  to  evaluate  them. 

2.  Spread  the  standards  out  before  you  so  that  you  can  get  what  they 
contain  in  perspective. 

3.  Arrange  the  slips  on  which  standards  are  printed  in  the  order  of  the 
importance  of  the  standards  in  the  results  of  teaching,  beginning  with  the 
most  important. 

4.  If,  in  your  judgment,  the  least  important  standard  is  so  low  as  to 
approach  zero,  mark  it  zero. 

5.  Pin  slips  together  in  the  order  in  which  you  rank  the  standards  and 
return  them  in  that  order. 

One  hundred  and  thirty-two  persons,  all  of  whom  were  engaged 
in  school  work,  assisted  in  the  study  by  arranging  these  standards. 
Fifty  of  the  judges  worked  under  the  personal  direction  of  the 
author,  and  45  others  under  the  direction  of  one  or  another  of 
the  first  fifty.  The  remainder  of  the  judges  received  the  material 
by  mail.  Seven  of  the  replies  were  rejected  because  it  was  ap- 
parent that  the  persons  making  them  had  not  followed  directions. 
The  returns  from  125  judges  were  tabulated. 
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A  few  less  than  a  hundred  judges  may  be  grouped  into  four 
divisions  as  follows:  A  group  of  graduate  students  in  a  certain 
university,  a  group  of  local  teachers,  a  group  of  teachers  and 
teachers-in-training  in  a  city  normal  school,  and  a  group  made  up 
of  elementary  and  junior  high-school  teachers  working  under  one 
principal  in  a  large  city.  The  remainder  of  the  judgments  were 
made  by  principals  and  superintendents  in  various  Michigan 
towns  and  cities. 

The  data  derived  from  the  125  judgments  are  as  follows: 

TABLE  I.      FREQUENCY  WITH  WHICH  EACH  RANK 
WAS  GIVEN  EACH  ITEM 


Item  No.» 

Rank* 

0 

1 

2 

3 

4 

5 

6 

7 

I 

U 

23 
19 
29 
28 
12 
3 

7 
23 
31 
28 
24 
4 
7 

28 
35 
23 
16 
12 
12 

79 

in 

9 

3 

6 

12 

18 

76 

9 
12 
10 
23 
43 
29 

13 
23 
27 
20 
32 
9 

13 

V 

14 

IV 

9 

n 

6 

VI 

4 

VII          

1 

*  The  higher  the  rank,  the  larger  the  number  indicating  the  rank.  Items  of  such 
small  value  as  to  be  insignificant,  in  the  opinion  of  the  judges,  are  scored  0. 

•  The  number  of  items  in  the  original  material  are  preserved  for  reference. 

Table  I  should  be  read  as  follows:  Seventy-nine  judges  thought 
Item  No.  I  most  important,  28  thought  it  second  in  importance, 
seven  thought  it  third  in  importance,  and  eleven  thought  it  fourth 
in  importance.     None  thought  it  less  than  fourth  in  importance. 

The  returns  for  the  different  groups  have  also  been  tabulated 
separately.     From  these  tabulations  the  following  facts  appear: 

1.  The  order  of  importance  of  the  items  is  the  same  in  the 
case  of  each  of  the  groups  of  judges. 

2.  The  general  form  of  each  distribution  for  each  item  is  the 
same  for  each  of  the  groups  of  judges. 

3.  The  judges  who  worked  under  the  personal  direction  of  the 
author  recognized  the  real  differences  in  relative  position  as 
established  by  the  whole  group  a  little  more  frequently  than  did 
the  judges  to  whom  the  material  was  sent  by  mail. 
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It  is  probably  safe  to  conclude,  therefore,  that  the  items  do  in 
reality  stand  in  the  order  of  importance  here  assigned.  On  the 
other  hand,  the  importance  of  this  order  may  be  great  or  small 
according  as  the  absolute  value  assigned  to  the  least  important 
item  in  the  list  is  great  or  small. 

From  Table  I,  the  values  of  the  various  items  in  terms  of  prob- 
able error  units  have  been  determined  and  corrected  into  point 
scales  of  100  and  1,000  points. 

TABLE  II.      THE  VALUES  OF  THE  ITEMS 


Percent  Each 

Adjusted  Points 

Value  of 

Cumulative  or 
Total  Values 

Value  Is  of 
Total  Value 

Intervals 

Basis  of 

Basis  of 

100 

1000 

0-VII          3.0 

VII            3.0 

7.37 

7 

75 

VII-VI        L6 

VI            4.6 

11.30 

11 

115 

VI-II          LO 

n            5.6 

13.76 

13 

135 

II-IV          0.3 

IV            5.9 

14.50 

14 

145 

IV-V           0.4 

V            6.3 

15.48 

16 

155 

V-III          0.2 

III            6.5 

15.97 

17 

160 

III-I           2.3 

I            8.8 

21.62 

22 

215 

Totals      8.8 

40.7 

100.00 

100 

1,000 

The  value  of  the  various  items  varies  according  to  the  value 
assigned  the  least  important  item  in  the  list.  For  example,  if 
Item  No.  VII  were  zero,  as  one  judge  would  have  it,  Item  No.  I 
would  be  5.8  units,  or  three  and  six- tenths  times  the  value  of 
Item  No.  VI,  under  the  same  condition.  Whereas,  under  the 
value  assigned  to  Item  No.  VII,  Item  No.  I  is  only  one  and  nine- 
tenths  times  the  value  of  Item  No.  VI.  On  the  other  hand,  if 
Item  No.  VII  were  assigned  a  value  of  5.0  units.  Item  No.  I  would 
be  only  about  two  times  the  value  of  Item  No.  VII;  whereas, 
under  the  value  now  assigned  to  Item  No.  VII,  Item  No.  I  is 
three  times  as  important  as  Item  No.  VII.  Without  going  any 
further  into  the  need  for,  and  difficulties  involved  in,  trying  to 
fix  a  value  for  one  of  the  items  with  reference  to  zero,  it  may  be 
said  that  three  units  were  adopted  as  the  value  of  the  least  impor- 
tant item,  mainly,  because  the  author  was  in  constant  contact 
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with  a  number  of  judges  who  were  willing,  for  the  most  part,  to 
allow  a  value  that  high  for  the  item  in  question,  but  were  unwilling 
that  the  value  should  be  placed  any  higher.  The  reason,  then, 
for  assigning  a  value  of  three  units  to  Item  No.  VII,  deportment^ 
was  a  practical  one  rather  than  a  scientific  one. 

The  rating  scheme  which  follows  is  based  upon  the  values 
given  in  Table  II. 

FIGURE  2.      TENTATIVE    PLAN    FOR    RATING    A    TEACHER    ON    THE 
PROGRESS  SHOWN  BY  PUPILS 


Teacher 

Experience 
Grade 


-Training- 


Subject. 


Date_ 


Rough  estimate  of  General  Merit:    A  B  C  D  E  (Circle  thus:  (S)) 
Analysis  of  results  or  progress  by  observation,  examination,  or  application  of 
standardized  tests  or  scales,  or  by  two  or  more  of  these  methods: 


General  Merit 

I.  Deportment 

II.  Ethical  self-control . . 

III.  Emotional  reaction . . 

IV.  Morale 

V.  Initiative 

VI.  Knowledge  and  skill . 
VII.  Thinking 


E 

D 

2 

23 

234 

234 

2345 

2345 

12 

3456 

B 


345 

45678 

56789 

5  6  7  8  9  10 

67  89  10  11 

6  7  8  9  10  11  12 

7  8  9  10  11  12  13  14  15  16 


6 
9  10 

10  11  12 

11  12  13 

12  13  14  15 

13  14  15  16 
17  18  19  20 


7 
11 
13 
14 
16 
17 
2122 


Summary:  Numerical  score- 


Equivalent:  A  B  C  D  E     (Circle  thusi 


Explanation:  Numbers  for  each  item  in  the  groups  A,  B,  C,  D,  and  E  give  the 
foUowingapproximately  correct  numerical  values  for  each  group:  A  (superior)  93-100; 
B  (above  average)  72-92;  C  (average)  30-71;  D  (below  average)  9-29;  E  (inferior)  0-8. 

Suggestions  for  Improvement: 

(Criticisms  interpreting  the  rating  given  usually  cover  several  type- 
written pages,  and  contain  references  to  the  list  of  "concrete  acts"  appearing 
below,  results  of  standard  tests  given  to  pupils,  and  the  principles  of  educa- 
tion as  expressed  in  standard  books  on  education  and  psychology.  A  brief 
summary  of  this  material  appears  here.  Copies  are  kept  for  reference  and 
comparison.) 
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While  still  working  with  the  typical  mixed  rating  scheme  pre- 
pared as  the  result  of  the  first  cooperative  patchwork  on  rating 
plans,  considerable  progress  was  made  in  collecting  concrete 
examples  of  each  standard  proposed.  Enough  was  done  to  make 
it  clear  that  the  bulk  of  such  material,  if  collected,  would  be 
enormous.  While  work  was  progressing  on  the  evaluation  of  the 
seven  general  headings,  some  attempt  was  made  to  choose  applica- 
ble material  from  the  earUer  study  and  restate  it  a  ^  a  list  of  con- 
crete acts,  which,  if  observed  in  pupils,  would  be  some  evidence 
that  the  standards  under  which  they  were  classified  were  being 
acquired.  To  this  material  were  added  statements  concerning 
the  standard  tests  and  scales  in  use  or  proposed  for  use  in  Republic 
schools.  Lastly,  teachers  contributed  an  enormous  amount  of 
material  so  detailed  that  it  was  thought  necessary  for  present 
purposes  to  have  a  committee  classify,  arrange,  and  condense 
it  into  the  limits  of  seven  mimeographed  pages. 

The  Ust  of  concrete  acts  which  follows  represents  a  condensed 
statement  of  the  supporting  material  used  with  the  proposed 
scheme  for  rating  teachers  on  the  basis  of  the  results  of  their 
teaching.  Any  teacher,  pupil,  or  supervisory  officer,  attempting 
to  use  this  material  will  of  necessity  choose  only  those  items 
applicable  to  the  case  in  hand.  Many  teachers  have  prepared 
for  themselves  much  more  complete  and  detailed  examples  under 
each  standard,  but  they  fall  under  some  of  the  headings  given. 

CONCRETE  ACTS 
Standard  I.    Thinking 

1.  Attains  standard  score  for  his  grade  in 

a.  Stone's  Reasoning  Tests  (grades  3-8) 

b.  Composition  (grades  4-12) 

c.  Trabue  Language  Scale  (grades  2-12) 

d.  Thorndike's  Visual  Vocabulary  Scales  (grades  3-12) 

e.  Thorndike's  Scale  Alpha  2  for  Measuring  the  Understanding  of 

Sentences  (grades  3-12) 

f.  Starch's  Physics  Test 

g.  Henmon's  Latin  Tests,  etc. 

2.  Attains  normal  school  grades  in 

a.  School  tests  over  minimum  essentials  in  arithmetic 

b.  Teacher's  or  superintendent's  test  in  other  subjects 

c.  School  tests  in  grammar  (grades  5-8). 

3.  Expresses  himself  clearly  in  his  own  words. 

4.  Exhibits  ready  ability  in  reproducing  in  recitations  the  thinking  that  has 

been  done  before  in  mastering  past  work. 
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5.  Interprets  intelligently  any  complex  directions  for  work. 

6.  Classifies  and  arranges  material  well. 

7.  Defines  accurately,  though  sometimes  awkwardly.    (In  the  kindergarten 

by  pointing  and  gesturing.) 

8.  Locates  and  defines  difficulties  in  material  suitable  for  his  grade. 

9.  Proposes  solutions  to  problems  cautiously  and  tries  them,  selecting 

and  rejecting  material  intelligently. 

10.  Reaches  tentative  conclusions  and  holds  them  tentatively  while  searching 

for  more  evidence. 

11.  Verifies  conclusions  carefully  before  considering  them  final. 

12.  Considers  the  bearings  of  conclusions  carefully. 

13.  Accepts  the  true  bearings  of  conclusions  when  they  are  pointed  out. 

14.  Evaluates  problems  as  well  as  the  material  used  in  the  solution  of  prob- 

lems. 

15.  Decides  correctly  when  to  depend  on  his  own  resources  and  when  to  seek 

help. 

Standard  II.    Knowledge  and  Skill 

1.  Attains  standard  scores  for  his  grade  in 

a.  Courtis  Standard  Research  Tests,  Series  B,  in  fundamentals  of 

arithmetic  (grades  4-8) 

b.  Woody's  Arithmetic  Scales  (grades  2-8) 

c.  School  tests  in  minimum  essentials  in  arithmetic  (grades  3-8) 

d.  School  tests  in  minimum  essentials  in  grammar  (grades  5-8) 

e.  Spelling  words  from  Ayres  Spelling  Scale  concealed  in  sentences 

f.  Composition,  technic  (grades  2-12) 

g.  Copying  familiar  material  (rate  and  quality)  Ayres  Handwriting 

Scale  "Gettysburg  Edition" 
h.  Stone's  Reasoning  Tests  (grades  3-8) 
i.    Trabue's  Language  Scale  (grades  2-12) 
j.    Starch's  Physics  Test 

k.  Thorndike's  Visual  Vocabulary  Scale  (grades  3-12) 
1.    Thorndike's  Scale  Alpha  2  for  Measuring  the  Understanding  of 

Sentences  (grades  3-12) 
m.  Henmon's  Latin  Tests 
n.  Rugg  and  Clark's  Standardized  Tests  in  First- Year  Algebra 

2.  Attains  normal  grades  on  teacher's  and  superintendent's  tests  in  subjects 

not  covered  by  standard  tests. 

3.  Exhibits  daily  in  the  recitation  a  ready  knowledge  of  facts  and  skill  in 

fundamental  processes  of  the  subject  in  hand. 

Note:  Whatever  value  is  assigned  to  items  2  and  3  should  be  appor- 
tioned about  equally  among  the  subjects  for  which  the  teacher  is 
responsible,  and  for  which  satisfactory  standard  tests  have  not   yet 
been  devised. 
Standard  III.    Initiative  in  Socially  Significant  Situations 

1.  Asks  questions  worth  while  for  the  whole  group  to  answer. 

2.  Proposes  problems  essential  to  the  progress  of  the  group  in  the  subject  at 

hand. 
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3.  Examines  material  in  advance  so  as  to  be  of  service  to  the  teacher  and  the 

class  in  laying  out  the  work  for  the  following  day  or  week;  i.e.,  assists 
actively  in  making  the  assignment. 

4.  Volunteers  information,  and  makes  helpful  suggestions  in  the  course  of 

the  recitation. 

5.  Seizes  upon  class  problems  for  further  reading  or  experiment. 

6.  Prepares  to  contribute  intelligently,  and  offers  promptly  and  eagerly  to 

keep  the  topic,  question,  or  problem  going  during  the  recitation. 
Note:  Many  recitations  make  one  think  that  teaching,  like  mining  (or 
dentistry),  is  an  extractive  industry. 

7.  Calls  attention  to  current  literature,  discoveries,  inventions,  or  public 

affairs  as  related  to  topics  or  questions  on  hand. 

8.  Proposes  for  group  decision  the  game  to  be  played  during  the  play  or 

language  periods. 

9.  Proposes  changes  in  games  and  discusses  the  changes  with  teacher  and 

pupils. 

10.  Is  not  idle  when  assigned  work  is  finished,  but  finds  useful  work  to  do. 

11.  Discovers  his  weak  points  and  practices  to  overcome  them. 

12.  Does  many  useful  things  without  being  told. 

13.  Asks  for  needed  information  or  suggestions  when  his  own  resources  fail. 

Standard  IV.    Morale 

1.  Attends  school  regularly,  and  arrives  promptly  at  the  opening  of  each 

session. 

2.  Is  cheerful,  and  agreeable  when  he  cannot  have  his  own  way. 

3.  Moves  to  and  from  classes  and  about  halls  in  a  prompt  and  orderly 

manner. 

4.  Is  loyal  to  teachers  and  the  work  they  assign. 

5.  Is  loyal  to  school  officers  and  the  rxiles  they  make  and  enforce. 

6.  Is  loyal  to  the  school  and  its  undertakings. 

7.  Obeys  all  ordinary  requests  promptly  and  cheerfully,  and  in  spirit  as  well 

as  letter. 

8.  Does  not  talk  back  or  sulk  when  corrected. 

9.  Does  not  fret  or  worry  over  school  tasks,  but  seeks  to  understand  them 

and  does  his  best  cheerfully. 

10.  Does  not  cry,  whine,  or  tattle  over  little  things. 

11.  Is  not  discouraged  by  defeat  or  failure. 

12.  Does  hard  or  otherwise  disagreeable  work  without  expectation  of  praise. 

13.  Works  in  the  confidence  that  he  and  his  classmates  can  do  what  other 

boys  and  girls  have  done  and  are  doing,  and  a  little  more. 

14.  Relies  upon  his  own  efforts  in  preparing  a  lesson. 

15.  Undertakes  with  courage  work  he  knows  to  be  difficult. 

16.  Finishes  assigned  lessons  even  if  he  is  compelled  to  spend  more  time  on 

them  than  some  of  his  brighter  classmates. 

17.  Begins  work  promptly  and  plunges  into  the  heart  of  it. 

18.  Faces  duties  and  responsibilities  squarely — does  not  "sidestep"  or  "pass 

the  buck." 

19.  Does  not  hunt  for  and  elect  supposed  "snap  courses." 
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20.  Is  conscious  of  some  of  the  important  habits  which  go  to  make  up  a 
worthy  character,  and  strives  to  act  so  that  these  habits  will  be  formed. 
Standard  V.    Emotional  Reaction 

1.  Appreciates  standards  of  achievement  in  school  subjects  and  wants  to 

attain  them. 

2.  Appreciates  standards  of  achievement  in  school  subjects  and  wants  his 

class  and  his  school  to  attain  them. 

3.  Takes  pride,  but  not  foolish  pride,  in  his  class,  school,  city,  state,  or  nation. 

4.  Takes  pride  in  superior  workmanship,  and  will  not  do  slipshod  work. 

5.  Takes  pride  in  the  character  of  his  associates  and  chooses  them  so  that 

he  will  not  be  ashamed  of  them. 

6.  Takes  pride  in  cleanliness  of  person,  schoolroom,  premises,  and  streets. 

7.  Wants  to  serve  his  class,  school,  town,  state,  and  nation. 

8.  Enjoys  good  music,  literature,  and  art. 

9.  Likes  innocent  fun  on  every  proper  occasion. 

10.  Enjoys  school  exercises: — rhythm,  story-games,  free  games,  etc. 

11.  Gets  a  true  emotional  reaction  out  of  insight  into  external  truth  either 

in  science  or  in  religion  and  morals. 

12.  Feels  and  expresses  reverence  for  ties  of  friendship,  family,  and  religion. 

13.  Does  any  desirable  act  because  he  wants  to  be  helpful,  and  refrains  from 

undesirable  acts  because  he  dislikes  them. 

14.  Appreciates  kindly  motives  in  others  and  gets  satisfaction  out  of  express- 

ing his  appreciation. 

15.  Values  the  personaUty  of  others  and  his  own  as  well. 

16.  In  the  classroom  acts  of  service  are  popular. 

Standard  VI.    Ethical  Self-Control  in  Situations  Socially 
Significant 

1.  Obeys  requests  promptly  and  cheerfully. 

2.  Obeys  the  rules  of  the  school. 

3.  Enters  the  room  and  leaves  the  room  quietly  and  inconspicuously, 

especially  during  school  hours. 

4.  Avoids  coughing  or  spitting  in  public. 

5.  Does  not  intrude  on  another  person's  privacy  or  take  his  time  unjustly. 

6.  Does  not  "delay  the  game." 

7.  Tells  the  truth  without  evasion. 

8.  Borrows  little  and  returns  borrowed  articles  promptly  and  in  good 

condition. 

9.  Does  not  steal  or  even  borrow  without  permission. 

10.  Keeps  appointments. 

11.  Keeps  promises  made,  and  avoids  rash  promises. 

12.  Does  not  copy  work  or  seek  unfair  help  from  others. 

13.  Will  not  permit  copying  or  give  unfair  help  to  others. 

14.  Does  not  "bluff"  in  the  recitation. 

15.  Does  not  bribe,  trade,  blackmail  (threaten  to  tell)  or  use  any  other  undue 

influence  to  have  his  own  way  in  athletics  or  other  school  affairs. 

16.  Controls  temper  and  avoids  quarrels. 

17.  Does  not  allow  himself  to  be  bribed,  intimidated,  or  influenced  unduly  in 

any  way  in  school  affairs. 


352  JOURNAL  EDUCATIONAL  RESEARCH  Vol.  1,  No.  5 

18.  Does  not  tattle,  but  will  not  allow  the  interests  of  the  school  to  suffer  or 

injustice  to  be  done  because  of  lack  of  information  he  could  supply. 

19.  Does  not  tease  or  bully  weaker  persons  nor  allow  others  to  do  so  without 

protest. 

20.  Cooperates  in  protecting  school  buildings,  premises,  and  streets  from 

litter  such  as  fruit  skins,  paper,  and  marking. 
Standard  VII.    Deportment 

1.  Sits  well  back  in  seat  leaning  forward  from  his  hips,  feet  on  floor,  head 

erect,  and  forearms  resting  easily  on  desk  when  writing  or  working  at 
desk. 

2.  Rises  easily  from  seat,  stands  erect  on  both  feet,  free  from  desk,  in 

reciting  and  sits  again  easily. 

3.  Walks  or  runs  lightly  in  moving  about  classrooms  and  halls. 

4.  Speaks  and  reads  clearly  and  distinctly  so  that  every  person  in  the  room 

may  hear. 

5.  Holds  book  or  paper  in  correct  position  when  reading  orally. 

6.  Passes  and  collects  materials  quietly  and  easily. 

7.  Takes  out  and  puts  away  work  quickly,  quietly,  and  neatly. 

8.  Puts  on  and  takes  off  wraps  quickly  and  quietly. 

9.  Does  not  stop  work  to  stare  at  visitors. 

10.  Is  courteous: 

a.  Is  unassuming. 

b.  Avoids  abrupt  speech  and  coarse  manners. 

c.  Laughs  and  talks  quietly. 

d.  Does  not  rush  or  crowd  in  halls. 

e.  Allows  others  to  enter  doors  ahead  of  him. 

f .  Keeps  to  the  right. 

g.  Avoids  passing  bet  ween  persons  in  conversation  or  in  front  of  anyone, 
h.  Grants  a  favor  or  acknowledges  one  easily. 

1 1 .  Does  not  put  pencils  or  pen  in  the  mouth,  or  fingers  in  mouth  or  nose. 

12.  Dresses  neatly  and  is  clean. 

13.  Keeps  working  materials  in  order  on  desk,  and  at  the  board. 

14.  Turns  in  neat  work. 

15.  Responds,   when  addressed,   pleasantly  and  in  good  form,  answering 

questions,  "Yes,  Miss ";  "No,  Miss ";  or  giving 

information  in  clear  sentences. 

A  careful  reading  of  the  above  list  of  concrete  acts  will  reveal 
that  the  means  at  hand  for  making  scientific  observations  of  the 
progress  of  pupils  are  scanty.  It  is  still  necessary,  if  one  wishes 
to  know  whether  pupils  are  making  progress  in  forming  most  of 
the  desirable  habits  and  attitudes  which  they  ought  to  form  as 
the  result  of  their  school  experience,  to  watch  them  at  work  and 
play  in  all  the  situations  for  which  the  school  is  responsible.  Con- 
sequently, it  would  be  foolish  to  assert  that  the  most  careful 
observer  can  detect  more  than  the  general  trend  of  habit  and 
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attitude  formation  outside  of  the  limited  field  now  occupied  by 
the  scales  and  tests.  This  is  one  of  the  strong  points  made  by 
teachers  against  the  author's  use  of  the  rating  scheme  in  rating 
their  work. 

It  does  not  seem  at  all  impossible,  however,  that,  should  we 
develop  means  of  measuring  progress  in  habit  and  attitude  forma- 
tion along  the  lines  indicated  in  the  concrete  acts  proposed  above, 
we  would  soon  develop  a  technic  of  producing  the  desired  results 
in  boys  and  girls  with  a  great  deal  more  certainty,  ease,  and 
rapidity  than  we  now  have  reason  to  believe  we  shall  develop  it 
in  the  next  fifty  years.  At  least  the  lists  above  furnish  the  basis 
for  further  experimental  work. 

The  facts  in  regard  to  the  actual  ratings  given  teachers  from 
1916  to  1919  are  shown  in  Tables  III,  IV,  and  V. 

If  the  marks  given  below  represent  the  facts,  the  first  semester 
the  rating  scheme  was  in  use  the  median  teacher  in  Republic  was 
a  low-average  teacher.  The  second  semester,  an  average  teacher; 
the  third  semester,  an  average  teacher;  the  fourth  semester,  a 
high-average  teacher;  the  fifth  semester,  an  above-average  teacher; 
and  the  sixth  semester,  an  above-average  teacher.  Reference  to 
the  rating  scheme  above  would  indicate  that  the  gain  was  from  a 
median  teacher  of  ability  35  to  a  median  teacher  of  ability  80. 
In  other  words,  in  the  judgment  of  the  superintendent,  the 
efl&ciency  of  the  average  teacher  in  Republic  schools  as  a  result- 
getter  more  than  doubled  in  the  three  years  under  discussion,  and 
this  in  spite  of  the  fact  that  the  above-average  teachers  were 
being  drawn  off  by  schools  which  paid  better  salaries  at  least  as 
fast  as  the  superintendent  was  able  to  improve  or  eliminate  the 
teacher  of  below-average  ability.  The  explanation  can  be  found 
only  in  the  fact  that,  with  better  salaries,  and  clearer  notions  of 
what  good  teaching  really  meant,  the  superintendent  was  enabled 
to  recruit  from  other  cities  and  from  normal  schools  and  colleges 
a  higher  grade  of  teacher  material  than  ever  before.  For  example, 
20  percent  of  the  teachers  now  employed  in  Republic  achieved 
honors  for  scholarship  in  normal  school  or  college.  Some  others 
were  recommended  as  the  best  students  in  special  departments. 
However,  this  does  not  discredit  the  value  of  the  rating  scheme 
as  a  supervisory  device  for  the  superintendent  proved  able  to 
develop  teachers  while  in  service.  Thirty-seven  percent  of  the 
teachers  who  have  been  employed  for  a  semester  or  more  in 
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TABLE  III.      RATING  OF  INDIVIDUAL  TEACHERS — 

SIX  SEMESTERS,  1916-1919 

REPUBLIC  TOWNSHIP  SCHOOLS,  REPUBLIC,  MICHIGAN 


1916-17 

1917-18 

1918-19 

Teacher 

1st 
Semester 

2nd 
Semester 

1st 
Semester 

2nd 
Semester 

1st 
Semester 

2nd 
Semester 

Withdrawal 

1 
2 
3 
4 

c 
c 

B 
C 
D 
C 
C 
B 
E 
C 
D 
D 
D 
B 
E 
B 
C 
C 
C 
C 
C 

D 
C 
B 
C 
D 
C 
C 
B 
D 
B 
D 
C 
D 
B 

D 
C 
B 
C 
C 
C 
D 

D 
C 
B 
B 
C 
C 

C 

c 

A 

B 
C 
A 

Request  of  supt. 
Promotion 

5 
6 
7 

B 

c 

B 
C 

Request  of  supt. 
Request  of  supt. 
Poor  health 

8 

9 
10 

C 

C 

C 

B 

Request  of  supt. 
Promotion 

11 

E 

Request  of  supt. 
Dissatisfaction 

12 

13 

Dissatisfaction 

14 
15 

B 

B 

B 

B 

Retirement 
Marriage 

Marriage 
Promotion 

16 
17 

B 
C 

B 

B 

A 

A 

18 

19 
20 

C 
C 

C 

C 

C 

C 

Promotion 

21 

Death  in  family 
Request  of  supt. 
Promotion 

22 

C 
B 
C 

D 

E 

23 

24 

B 
B 
E 
C 
B 
C 
C 
C 

B 
B 
D 
B 
B 
B 
B 
C 
C 
D 

Promotion 

25 

B 
B 
B 
B 
C 
B 

B 
B 
B 

B 
B 

26 

27 

28 

Poor  health 

29 

30 

31 

Promotion 

32 

Promotion 

33 

B 

B 
B 
D 
B 
B 
B 

34 

35 

D 
B 
B 
B 

36 

37 

38 

Death 

A  blank  in  the  column  "reason  for  withdrawal"  means  that  the  teacher 
is  still  in  service  in  Republic  schools. 

"Promotion"  means  taken  by  some  other  city  at  a  higher  salary. 
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TABLE  IV.      DISTRIBUTION  OF  MARKS  GIVEN  TO  TEACHERS, 

BY  SEMESTERS,  1916-1919 

REPUBLIC  TOWNSHIP  SCHOOLS,  REPUBLIC,  MICHIGAN 


1916-17 

1917-18 

1918-19 

Mark 

1st 

2nd 

1st 

2nd 

1st 

2nd 

Total 

Semester 

Semester 

Semester 

Semester 

Semester 

Semester 

A 

2 
11 

2 
14 

4 

B 

4 

6 

6 

10 

51 

C 

11 

10 

10 

7 

7 

3 

48 

D 

4 

5 

3 

3 

1 

1 

17 

E 

2 

2 

1 

5 

Total 

21 

21 

21 

21 

21 

20 

125 

TABLE    V.      DISTRIBUTION    OF    LAST    MARKS    GIVEN    TO    TEACHERS 
WITHDRAWING  FROM  REPUBLIC  SCHOOLS 


Mark 

Reason  por  Withdrawal 

Totals 

Required 

Promotion 

Other  Reasons 

A 

B 
C 
D 

1 

3 
2 
2 

5 
4 

3 

2 

9 
9 

2 

E 

1 

3 

Total 

8 

9 

6 

23 

Republic  schools  during  the  last  three  years  have  shown  enough 
improvement  to  cross  the  boundary  between  a  lower  and  a  higher 
rank.  Fifty-three  percent  of  the  teachers  now  in  Republic  schools 
have  improved  at  least  one  division.  In  other  words,  supervision, 
as  it  found  expression  in  suggestions  for  improvement  in  the  items 
of  the  rating  scheme,  was  about  equally  responsible  with  elimina- 
tion of  the  less  capable  and  the  employment  in  their  places  of  the 
more  capable  type  of  teacher,  for  whatever  improvement  has 
taken  place  in  the  efficiency  of  the  teaching  corps. 

Of  course,  the  question  of  the  accuracy  of  the  ratings  of  the 
teachers  is  an  important  one.  The  study  has  the  limits  imposed 
by  the  fact  that  one  judge,  and  only  one,  rated  the  work  of  one 
group  of  teachers,  and  only  one.     On  the  other  hand,  the  methods 
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used  in  rating  were,  it  is  believed,  vastly  more  objective  and 
hence,  more  reliable,  than  those  presented  in  any  other  rating 
study  yet  made.  To  the  mind  of  the  author  the  greatest  evidence 
against  the  vahdity  of  the  absolute  rating  is  the  fact  that  the 
median  teacher  is  rated  above  average,  and  that  the  distribution  of 
teachers  is  around  that  point  instead  of  around  a  teacher  rated 
average.  Every  other  bit  of  evidence  points  to  the  fact  that  a 
very  marked  improvement  has  taken  place  in  the  teaching  corps 
in  Republic  schools.  Hence,  if  serious  error  has  been  made,  it 
was  made  when  the  teachers  of  RepubHc  were  rated  for  the  first 
time  in  January,  1917. 

The  absolute  authority  placed  in  the  hands  of  the  superintend- 
ent to  eliminate  teachers  had  so  much  to  do  with  whatever  suc- 
cess attended  the  use  of  the  payment-for-merit  plan,  that  it  would 
be  foolish  to  recommend  the  plan  for  general  adoption  where  the 
authority  mentioned  does  not  exist.  The  reasons  for  which 
teachers    could   be   dismissed   were   as   follows: 

1.  Low  efficiency,  without,  in  the  judgment  of  the  superintend- 
ent,   prospect    of   improvement   in    the    immediate    future. 

2.  Acts  injurious  to  the  interests  of  the  school  or  the  community, 
repeated    after    warning   by    the    superintendent. 

Republic,  like  every  other  community  in  the  land,  has  its  school 
politicians.  These  men  and  women  study  constantly  every 
feature  of  school  administration,  supervision,  and  teaching,  not 
for  the  sake  of  providing  better  school  facilities  for  boys  and  girls, 
but  for  the  sake  of  gaining  personal  advantage  from  any  phase  of 
school  work  which  can  be  put  in  the  wrong  light  before  the  pubHc. 
These  persons  do  not  have  to  be  reasonable  or  consistent  in  order 
to  be  troublesome.  Soon  after  the  bonuses  were  made  large 
enough  to  attract  their  attention,  they  began  to  demand  that  the 
amount  of  the  additional  compensation  should  be  saved  to  the 
public.  They  contended  that  a  teacher  would  teach  a  year  for 
the  basal  salary  just  as  willingly  and  just  as  efficiently  as  she  would 
for  the  basal  salary  plus  the  bonus.  They  contended  further  that 
the  teacher  who  was  not  that  sort  of  an  idealist  was  not  fit  to 
teach  boys  and  girls  anyhow.  Even  if  the  scheme  could  have  been 
defended  successfully  from  attacks  from  without,  it  would  still 
have  been  in  the  way  when  it  came  to  employing  new  teachers; 
for  the  teachers  desired  could  hardly  have  been  employed  even  for 
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a  sum  equal  to  the  basal  salary  and  the  median  bonus  ($100  a  year) 
combined.  It  was  clearly  impossible  to  secure  funds  to  care  for 
the  bonuses  in  addition  to  the  necessary  basal  salaries.  Hence, 
the  additional  compensation-for-merit  scheme  was  abandoned  in 
1919  and  the  superintendent  and  most  of  the  teachers  breathed 
a  sigh  of  relief. 

The  rating  scheme  proposed  above  is  still  in  use  as  a  supervisory 
device,  but,  of  course,  without  any  relation  to  the  salary  schedule. 
Used  in  this  way,  the  rating  card  is  a  valuable  supervisory  instru- 
ment.    Additional  evidence  of  this  fact  was  obtained  as  follows: 

Some  time  following  the  fifth  semi-annual  rating  the  superin- 
tendent was  requested  to  present  the  results  of  his  inquiry  before  a 
state  meeting  of  superintendents  and  school  board  members.  Ac- 
cordingly, the  following  notice  was  sent  to  teachers  in  the  largest 
building  in  Republic  Township  : 

I  have  been  asked  to  present  the  results  of  my  investigation  leading  to  a 
tentative  scheme  for  rating  teachers  before  the  State  Association  of  Super- 
intendents and  School  Board  Members.  Before  accepting  the  invitation,  I 
should  like  your  candid  opinion  as  to  whether  your  cooperation  in  forming 
the  scheme  and  in  being  rated  by  it  has  affected  your  work  and  how.  Record 
your  conclusions  on  this  paper  without  consultation  and  without  signing 
the  paper.  No  effort  will  be  made  to  hold  anyone  responsible  for  adverse 
judgments.  Indeed,  no  effort  will  be  made  to  discover  who  wrote  which 
paper.  However,  the  opinions  may  be  classified  as  to  the  amount  of  profes- 
sional thought  they  reveal  before  they  are  presented  to  the  Republic  teachers 
or  any  other  audience. 

Wm.  L.  Connor 
Superintendent 

Replies  were  received  in  sealed  envelopes,  shufHed  thoroughly 
by  a  clerical  assistant,  and  typed  for  the  consideration  of  the 
superintendent.  They  ranged  from  replies  as  favorable  as  the 
following: 

My  opinion  of  the  rating  scheme  is  as  follows: 

First,  it  aids  the  teacher  to  measure  her  pupils,  and  find  their  weaknesses, 
thereby  giving  her  a  chance  to  help  them  overcome  their  trouble,  whereby 
the  teacher  gets  the  result  required. 

Second,  it  helps  the  teacher  to  measure  herself  and  gives  her  a  chance  to 
study  the  standard  by  which  she  is  measured. 

Third,  following  the  rating  scheme  as  closely  as  possible  helps  my  pupils 
to  think  and  helps  me  to  help  them. 
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To  those  as  unsatisfactory  as  the  following: 

If  my  cooperation  in  forming  our  rating  scheme,  and  being  rated  by  it, 
has  in  any  way  affected  my  work  in  the  school  I  am  entirely  unconscious  of  it. 

Of  the  seventeen  replies  received,  twelve  were  favorable  and  five 
adverse  or  noncommittal.  The  comments,  however,  make  it 
clear  that  a  great  deal  of  good  came  out  of  the  work  of  rating 
teachers.  On  the  other  hand,  it  would  be  difficult  to  read  through 
the  discussions  presented  without  gaining  the  impression  that  a 
great  deal  of  misunderstanding  and  hard  feeling  existed.  Indeed, 
enough  soreness  is  in  evidence  to  have  disrupted  any  administra- 
tion not  securely  founded.  However,  the  dissatisfaction  was 
directed  more  against  the  payment-for-merit  plan  than  against  the 
actual  operation  of  the  rating  scheme  as  a  supervisory  device. 

It  is  safe  to  say  that  at  least  three-fourths  of  all  teachers 
employed  in  Republic  schools  were  willing  to  work  under  the 
merit  plan,  and  very  seldom  did  the  other  fourth  openly  express 
dissatisfaction.  How  much  of  this  seeming  content  was  due  to  the 
fact  that  everybody's  salary  was  going  up  anyhow  (the  scheme  was 
accompanied  by  a  general  rise  in  wages  in  no  essentail  way  related 
to  it),  how  much  of  it  was  due  to  the  merits  of  the  rating  scheme, 
how  much  to  the  fact  that  teachers  cooperated  in  forming  the 
plan,  and  how  much  to  the  fact  that  the  superintendent  exercised 
rather  unusual  powers  in  employing  and  discharging  teachers,  it 
would  be  hard  to  tell. 

However,  if  the  superintendent  of  the  Republic  schools  could 
secure  a  living  and  saving  wage  for  the  least  experienced  and  poor- 
est trained  teacher  in  the  corps,  together  with  reasonable  increases 
for  additional  experience  and  training,  up  to  75  percent  more  than 
the  minimum  wage,  he  would  recommend  that  the  question  of 
extra  compensation  for  merit  be  reopened. 

In  the  meantime,  the  rating  card  proposed  above,  while  imper- 
fect in  certain  respects,  is  still  in  use  in  supervision,  and  really 
represents  an  advance  over  previous  efforts.  It  is  a  useful 
supervisory  device  because  it  directs  attention  effectively  to  im- 
portant elements  in  the  changes  which  it  is  a  teacher's  task  to 
produce  in  children. 


REPRODUCTION  AS  A  MEASURE  OF  READING  ABILITY^ 

Arthur  W.  Kallom 
Department  of  Educational  Investigation  and  Measurement,  Boston,  Massachusetts 

The  Importance  of  Silent  Reading 
Reading  in  some  form  occupies  a  large  share  of  the  curriculum 
of  both  lower  and  upper  grades.  In  the  first  grade  the  time  is 
almost  wholly  occupied  in  teaching  children  how  to  read;  and, 
oral  reading  predominates.  As  the  child  progresses  through  the 
grades  the  time  devoted  to  oral  reading  gradually  diminishes  and 
the  time  devoted  to  silent  reading  increases. 

These  two  forms  of  reading  have  entirely  different  aims.  Oral 
reading  above  the  primary  grades  aims  to  convey  the  thought  to 
some  hearer.  Correct  pronunciation,  clear  expression,  and  good 
enunciation  are,  therefore,  necessary  in  the  oral  work.  These, 
however,  are  only  the  mechanics  which  enable  the  reader  to  con- 
vey the  thought  which  he  has  in  mind  with  force  and  understand- 
ing. 

In  silent  reading,  on  the  other  hand,  the  aim  is  to  teach  the 
pupil  to  obtain  the  thought  from  the  printed  page  for  himself. 
This  silent  reading  is  followed  by  some  form  of  reproduction 
either  at  once  or  at  some  future  time.  Until  recently  the  teacher 
of  the  upper  elementary  grades  has  not  felt  the  importance  of 
teaching  silent  reading.  Even  now  it  is  very  probable  that  she 
does  not  realize  the  full  importance  of  this  teaching.  Reading, 
oral  or  silent,  means  the  recognition  of  the  printed  word  as  a  sym- 
bol and  a  correct  interpretation  of  the  symbol  into  a  picture  for 
which  the  symbol  stands. 

Factors  in  Silent  Reading 
This  is  not  by  any  means  a  simple  process.     It  may  be  analyzed 
into  the  following  factors: 

1.  Correct  visualization  of  each  word 

2.  Knowledge  of  the  various  meanings  of  each  word 

3.  Choice  of  the  correct  meaning  as  shown  by  the  context 

1  An  address  delivered  before  the  National  Association  of  Directors  of  Educational 
Research  at  Cleveland,  Ohio,  February,  26,  1920.  In  the  absence  of  Mr,  Kallom 
the  address  was  presented  by  Miss  Harriet  M.  Barthelmess. 
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4.  Forming  of  the  correct  relations  between  these  meanings  in 
order  to  interpret  phrases  and  clauses 

5.  Forming  of  the  correct  relations  between  phrases  and  clauses 
in  order  to  interpret  sentences  and  paragraphs. 

This  interpretation  of  words,  phrases,  sentences,  and  paragraphs 
depends  on  at  least  two  things:  (a)  the  pupil's  experience; 
(b)  his  ability  to  recall  the  experience  and  apply  it  to  the  case  at 
hand. 

Any  inability  on  the  part  of  the  pupil  to  make  application  of  his 
experiences  or  the  making  of  a  wrong  application  results  in  error. 

Two  illustrations  will  make  this  thought  clear.  Question  14  of 
Kelly's  Kansas  Silent  Reading  Test  II  reads  as  follows: 

A  list  of  words  is  given  below.  One  of  them  is  needed  to  complete  the 
thought  in  the  following  sentence:  The  roads  became  muddy  when  the 
snow 

Do  not  put  the  missing  word  in  the  blank  space  left  in  the  sentence,  but 
put  a  cross  below  the  word  in  the  list  which  is  next  above  the  word  needed  in 
the  sentence. 

water 

is 

melted 

snow 

This  question  is  one  of  the  most  difficult  in  the  entire  test, 
being  given  the  value  of  4.9.  To  solve  this  question  correctly  the 
pupil  must: 

1.  Refrain  from  filling  in  the  blank  with  the  correct  word 

2.  Correctly  interpret  the  phrase  "below  the  word  in  the  list" 

3.  Correctly  interpret  the  clause  "which  is  next  above  the  word 
needed." 

These  three  phases  must  be  correctly  interpreted  not  only 
individually  hut  also  with  relation  to  each  other  in  order  to  get  the 
correct  answer.  The  high  value  of  4.9  for  this  question  is  proba- 
bly due  to  the  fact  that  pupils  do  not  see  the  relation  between  the 
parts  correctly.  Pupils  do  not,  as  a  rule,  fail  in  reading  the 
words  of  this  selection  nor  in  knowing  the  meaning  of  the  individ- 
ual words,  for  none  of  them  is  difficult,  but  they  do  fail  in  under- 
standing the  relation  between  the  words,  phrases,  and  clauses. 
The  failure  to  see  this  relation  is  often  laid  at  the  door  of  careless- 
ness. This  may  be  a  cause  at  times,  but  more  often  a  lack  of 
experience  in  meeting  such  a  complicated  situation  is  a  contribu- 
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tory  cause  and  at  times  may  be  the  important  cause  of  the  error. 
The  pupil  has  been  in  the  habit  of  placing  a  cross  before  or  after 
the  word,  and  when  he  reads  "put  a  cross"  his  experience  leads  him 
to  put  a  cross  before  or  after  the  word,  thus  making  an  error. 

But  pupils  also  make  wrong  interpretations  of  individual  words. 
One  of  the  tests  given  to  grade  v  in  May  1919  was  the  part  of  the 
story  of  Aladdin  in  which  the  magician  directs  Aladdin  to  go  to  the 
bottom  of  the  stairs  into  a  great  underground  building  divided 
into  three  vast  halls.  In  each  of  these  halls  Aladdin  was  to  find 
four  large  brass  vessels.  A  boy  who  had  read  this  selection  inter- 
preted the  word  "vessels"  to  mean  ships.  He  had  a  perfect 
picture  of  this  underground  room  as  some  sort  of  museum  in 
which  these  ships  were  placed.  After  some  questioning  as  to  what 
other  meaning  the  word  "vessels"  might  have,  he  remembered  the 
meaning  of  an  "urn"  or  "vase."  Immediately  his  whole  picture 
was  changed.  A  pupil  left  to  himself,  however,  does  not  get  a 
chance  to  have  this  impression  changed.  He  may,  therefore,  go 
on  for  some  time  on  the  basis  of  the  wrong  interpretation. 

The  teacher  may  learn  of  this  wrong  interpretation  only  through 
some  form  of  reproduction.  The  great  criticism  against  repro- 
duction has  been  that  it  involves  memory.  What  is  generally 
meant  is  word  memory  without  thought  or  without  meaning. 
This  should  be  decried  everywhere  and  at  all  times.  But  the 
right  kind  of  reproduction,  depending  on  the  right  kind  of  memory 
should  be  cultivated,  for  every  discussion  depends  on  the  ability 
to  think  correctly. 

Boston's  Progress 

In  1915  and  1916  Mrs.  EUor  Carlisle  Ripley,  assistant  superin- 
tendent of  schools,  was  placed  in  charge  of  the  reading  throughout 
the  schools  of  Boston.  In  undertaking  to  improve  both  oral  and 
silent  reading  four  plans  were  used : 

1.  Asking  principals  and  teachers  to  assemble  the  children  in 
the  auditorium,  having  the  best  readers  act  as  an  example  to 
others  by  reading  selections  before  the  audience  of  the  other 
pupils 

2.  Asking  students  in  the  various  schools  of  elocution  to  read 
selections  suitable  for  children  before  the  entire  school  in  the 
auditorium 
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3.  Selecting  two  or  three  of  the  best  readers  from  a  number  of 
different  schools,  assembling  them  at  a  central  school,  and  having 
them  read  prepared  and  unprepared  selections  before  an  audience 
of  other  pupils,  parents,  and  friends 

4.  Visiting  a  large  number  of  rooms  to  hear  the  children  (espe- 
cially the  poorer  ones)  read  in  their  regular  classes. 

In  conjunction  with  the  third  phase  of  this  work,  viz.,  when 
selected  children  had  gathered  from  a  number  of  schools  in  one 
auditorium,  the  Department  of  Educational  Investigation  and 
Measurement  used  the  Kelly  Silent  Reading  Test.  One  hundred 
and  eighteen  of  these  selected  children  were  tested  in  all.  They 
came  from  all  grades,  a  few  even  as  low  as  the  fourth,  although 
principals  were  encouraged  to  send  upper  rather  than  lower  grade 
children.  The  results  showed  that  these  pupils  had  a  large  range 
of  individual  differences.  There  was  a  great  deal  of  overlapping 
but  the  medians  were  from  two  to  eight  points  higher  than  the 
standards  set  by  Professor  Kelly. 

Selection  of  Material  for  Suitable  Testing 

As  a  result  of  having  the  Kelly  test  given  to  this  small  group  of 
selected  pupils,  many  of  the  teachers  felt  that  reading  ability  was 
not  being  tested.  They,  therefore,  wished  a  further  test  to  be 
made  with  selections  more  nearly  like  the  ordinary  reading  of 
pupils.  As  a  result  of  this,  in  the  fall  of  1916  a  committee  of 
teachers  representing  grades  iv  to  viii  inclusive,  met  for  the 
purpose  of  selecting  suitable  paragraphs  for  testing  grades  iv,  v, 
VI,  vii,  and  viii.  The  following  directions  were  given  for  guid- 
ing the  teachers  in  making  their  selections: 

1.  That  the  paragraph  selected  should  be  from  100  to  150  words 
in  length 

2.  That  the  paragraph  should  as  far  as  possible  tell  a  complete 
story 

3.  That  the  teachers  should  select  paragraphs  suitable  for  their 
own  grades 

4.  That  paragraphs  selected  should  not  be  famihar  to  the 
children. 

As  a  result  of  the  work  of  this  committee,  the  department 
received  for  each  grade  four  or  five  selections  which  the  teacher  of 
that  grade  thought  were  suitable.     The  members  of  the  depart- 
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ment  undertook  to  make  from  this  collection  of  material  a  selec- 
tion of  two  paragraphs  for  each  grade,  which  would  eventually  be 
used  for  testing.  Each  of  these  paragraphs  was  given  to  approx- 
imately five  hundred  children.  That  is,  a  paragraph  selected  for 
grade  iv  by  a  fourth-grade  teacher  was  given  to  grade  iv,  a 
paragraph  selected  for  grade  v  was  given  to  grade  v,  and  so  on. 
In  no  case  was  the  paragraph  selected  for  a  given  grade  given  to 
any  other  grade. 

Giving  and  Scoring  the  Tests 

The  tests  were  given  by  a  group  of  normal  school  seniors  who 
had  been  trained  to  give  them  in  a  uniform  manner.  The  pupil 
was  given  a  sheet  on  which  was  printed  the  selection  to  be  read. 
After  this  selection  had  been  read  once,  and  the  time  of  reading 
recorded  in  seconds,  it  was  collected  and  a  four-page  folder  given 
to  each  pupil  upon  which  he  was  asked  to  write  a  reproduction  of 
the  paragraph.  After  this  reproduction  was  written,  he  was 
asked  to  turn  to  the  last  page  of  the  folder  and  answer  some 
questions  based  on  the  paragraph  which  had  just  been  read.  In 
other  words,  the  pupil  was  required  to  do  four  things: 

1.  To  read  the  selection  once 

2.  To  record  the  time 

3.  To  reproduce  on  another  sheet  all  that  he  could  remember 

4.  To  write  from  memory  answers  to  questions  based  on  the 
paragraph. 

The  scoring  of  the  reproduction  was  based  on  the  number  of 
ideas  reproduced.  What  constituted  each  particular  idea  was 
decided  upon  previous  to  the  correction  of  the  test.  In  correcting 
the  material  it  was  very  difficult  at  times  to  determine  whether  the 
idea  had  been  reproduced  by  the  pupil  or  not.  In  many  other 
instances  it  was  perfectly  clear  that  the  pupil,  instead  of  repro- 
ducing the  paragraph  which  he  had  just  read,  brought  into  the 
reproduction  many  ideas  based  upon  his  experience. 

In  correcting  the  reproduction  wrong  spelling  was  not  consid- 
ered as  an  error.  How  much  the  inability  to  spell  a  word  inter- 
feres with  the  ability  to  reproduce  is  not  known. 
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Returns  from  Grade  IV 

The  following  was  one  of  the  stories  given  the  fourth  grade  to 
read  and  reproduce: 

Early  one  morning  Washington  left  his  quarters  and  went  alone  to  see 
for  himself  what  his  soldiers  were  doing  in  a  camp  which  he  had  ordered  to  be 
fortified.  The  weather  was  so  cold  that  he  wore  a  long  overcoat  with  a  great 
cape.  The  coat  covered  his  uniform,  and  his  hat  and  cape  did  not  leave  much 
of  his  face  to  be  seen.  For  this  reason  the  soldiers  who  saw  him  did  not 
know  that  the  tall  man  passing  by  was  their  general,  George  Washington. 

The  following  reproductions  of  the  foregoing  story  illustrate 
how  pupils  weave  into  their  reproduction  extraneous  ideas  which 
have  come  to  them  through  their  experience. 

When  Georges  Washington  was  a  boy  he  told  a  lie  when  grew  up  to  a 
Gengral  no  one  didn't  no  him  he  had  a  uniform  on  him  and  a  cape  and  a  cap. 

Early  one  morning  Goeoge  Washtongton  went  out  and  saw  Abraham 
Lincoln  in  the  window  and  said  to  him  do  you  no  me  yes  I  do  no  you  George 
Washtongton. 

In  the  first  instance  the  pupil  retains  the  ideas  of  "George 
Washington,"  "a  general,"  "uniform,"  "cape,"  and  "cap."  In 
addition  he  has  added  the  ideas  of  "when  he  was  a  boy  he  told  a 
lie."  In  the  second  reproduction  the  only  thing  which  was  retained 
was  that  the  story  was  about  George  Washington.  Bringing 
in  an  idea,  such  as  that  of  Lincoln,  which  has  nothing  to  do  with 
the  situation  is  an  interesting  but  not  uncommon  occurrence. 

Attention  has  been  called  to  the  fact  that  one  source  of  error  is  a 
misinterpretation  of  the  meaning  of  individual  words.  The  two 
following  reproductions  of  the  same  story  show  the  misinterpreta- 
tion of  the  word  "quarters": 

One  morning  Washington  left  his  quarters  on  the  table  and  went  to  see 
how  his  solderes  were  dowing. 

Once  Goerge  Washington  said  he  would  go  out  to  see  what  his  quarters 
where  doing  in  the  camp.  It  was  cold  so  he  had  to  put  on  his  big  warm  coat. 
He  saw  what  his  doildiers  were  doing.    He  said  let  us  go  out  to  camp. 

The  first  pupil  shows  that  of  the  different  meanings  of  the  word 
"quarters"  he  has  selected  the  wrong  one.  He  may  have  done 
this  either  through  ignorance  or  through  making  a  wrong  applica- 
tion of  his  experience  due  to  failure  to  remember  the  relation 
between  the  phrases  in  the  selection  given.  The  second  pupil 
evidently  has  a  very  hazy  idea  of  the  meaning  of  this  word  and 
possibly  no  correct  meaning  for  it. 
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Returns  from  Grade  VI 
Below  is  given  one  of  the  selections  given  in  grade  vi  under  the 
same  conditions  and  directions  as  used  in  grade  iv. 

The  baby  seals  make  us  think  of  young  dogs  and  they  play  together  like 
puppies.  The  mother's  call  to  her  little  ones  is  similar  to  that  of  a  sheep, 
and  her  babies'  cry  is  like  the  bleating  of  a  lamb.  When  they  are  about  six 
weeks  old  they  go  into  shallow  pools  and  learn  to  swim.  As  they  grow  stronger 
they  roll  down  into  the  sea  and  take  excursions  of  miles.  The  seals  are  so 
valuable  that  men  are  allowed  to  kill  only  a  few  of  them  each  year.  They 
are  not  hard  to  catch.  The  seal  hunters  carry  clubs  about  seven  feet  long 
and  as  thick  as  a  baseball  bat.  They  stun  the  animals  by  striking  them  on 
the  skull  and  then  other  men  come  along  with  sharp  knives  and  kill  them. 

The  following  is  a  reproduction  written  by  an  eleven-year-old 
girl: 

The  baby  seals  resemble  our  dogs  and  puppies.  There  mother's  cry 
sounds  like  a  sheep.  When  they  are  old  they  are  put  in  a  tank  to  learn  to 
swim.    When  they  are  older  they  toss  balls  in  a  circus. 

This  reproduction  indicates  the  importance  of  previous  ex- 
perience. Such  a  piece  of  work  is  often  discarded  by  the 
teacher  as  useless.  As  a  matter  of  fact  it  is  a  valuable  means  of 
determining  what  should  be  done  for  the  pupil.  The  question  to 
be  answered  is:  "Why  does  the  pupil  bring  in  the  ideas  about 
the  tank  and  the  circus?"  It  is  the  answer  to  this  "Why"  that 
should  guide  the  teacher  in  her  future  corrective  work  with  the 
pupil. 

Questions 

As  noted  above,  a  second  part  of  the  test  consisted  of  a  number 
of  questions  based  on  the  selection  read.  The  first  question  for 
the  fourth  grade,  with  the  answers  which  the  department  deemed 
acceptable  and  those  which  it  deemed  non-acceptable,  is  given 
below.  Each  of  the  non-acceptable  answers  was  given  by  one  or 
more  pupils.     In  all,  42  percent  answered  the  question  correctly. 

"Why  did  Washington  leave  his  quarters?" 

Acceptable  Not  Acceptable 

to  see  his  soldiers  because  of  his  trail,  to  see  a  man,  to  go  on 

to  see  soldiers  in  an  errand,   on  important  business,  it  was 

camp  cold,  he  was  a  general,  he  did  not  want  to 

to  see  his  men  take  it  with  him,  he  didn't  want  to  be  in 

to  see  his  army.  there,  he  had  too  much,  they  would  not 
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know  him,  he  died,  he  did  not  like  it,  his 
mother  died,  to  look  at  himself,  to  see  what 
they  were  doing,  because  he  had  to,  the 
quarters  are  American  money,  he  left  it  in  his 
pocket,  because  he  wanted  to,  because  they 
told  lies,  to  go  to  fight  the  Germans,  to  go  to 
a  'feet'. 
Three  types  of  answers  are  to  be  noted  among  the  non-accept- 
able: 

1.  Those  which  apparently  come  from  another  part  of  the  story 

Illustration:  because  it  was  cold 

because  he  was  a  general 

2.  Those  which  apparently  result  from  a  failure  to  use  the  right 
meaning  of  a  word 

Illustration:  the  quarters  are  American  money 
he  left  it  in  his  pocket 

3.  Those  which  apparently  have  nothing  to  do  with  the  story 
but  are  based  on  outside  experience 

Illustration:  because  his  mother  died 
because  they  told  lies 
to  go  to  fight  the  Germans. 

From  the  returns  as  a  whole  it  was  plain  that  the  paragraph  was 
too  difficult  for  fourth-grade  pupils  to  read  and  get  the  thought. 
Only  5  percent  answered  correctly  the  question  "What  had  Wash- 
ington ordered  done?"  Neither  was  this  idea  included  generally 
by  the  pupils  in  their  reproduction. 

In  answering  the  questions  on  the  story  about  the  seals  the 
sixth-grade  pupils  showed  the  same  tendency  to  draw  on  their 
experience  as  was  exhibited  by  the  fourth-grade  pupils.  At  one 
of  the  parks  in  Boston  there  is  an  aquarium  where  there  are  a 
number  of  seals.  The  familiarity  of  children  of  the  city  with  this 
aquarium  was  shown  by  the  pupils  of  the  sixth  grade  in  their 
reproductions,  and  particularly  in  their  answers  to  the  fourth 
question:  "Where  do  they  learn  to  swim?"  when  they  wrote  "at 
Marine  Park." 

Below  are  given  the  different  answers  to  the  first  two  questions 
of  this  selection — answers  which  seem  to  indicate  again  that  the 
pupil  draws  largely  on  his  experience  to  answer  questions.  If  the 
experience  suggested  by  the  reading  is  more  vivid  than  the  mind 
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picture  he  gets  from  correctly  interpreting  the  selection  read, 
he  tends  to  tell  the  story  of  that  experience. 

"What  do  baby  seals  look  like?" 
Acceptable  Not  Acceptable 

dogs  snails,  beavers,  bears,  long  and  narrow,  head 

puppies.  of  a  rat  and  tail  of  a  fish,  fox,  face  like  a  rat 

and  tail  like  a  fish,  gold,  like  tadpoles,  base- 
ball bat,  crabs,  like  big  ones,  bat,  smooth  soft 
skin,  dark  fur,  cat,  fish,  very  small,  mice, 
monkey,  lamb,  long  fur  with  spots  for  eyes, 
little  cubs,  Eskimos,  tiger,  hunter,  dragon, 
walrus  without  tusks. 
"What  does  the  young  seals'  cry  sound  like?" 
lamb  dog,  cat,  baby,  loud  cry,  bird's  cry,  cow,  lion, 

bleating  o  sheep,   horn,  bear,  screech,  deer,  whistle,  horse,  dog 
when  he  watches,  very  big,  like  a  ten-cent  horn, 
saw,   winds,   like   a  wake,   groan,   elephant, 
ma  ma,  goat,  sweet,  squeaky,  hoarse  voice, 
harsh,  very  loud  noise,  echo,  walrus,  shriek, 
wo'f,  girl,  when  you  sleep,  whales,  winds. 
The  first  question  was  answered  correctly  by  70  percent  of  the 
group  and  the  second  by  only  56  percent.     iMany  answers  show 
that  pupils  did  not  even  approximate  the  correct  answer  and  yet 
the  answer  shows  an  intimate  knowledge  of  the  seal  as  an  animal 
at  the  aquarium.     One  who  is  familiar  with  the  seal  would  not  find 
it  difficult  to  make  most  of  the  descriptions  fit. 

Summary 

One  of  the  purposes  of  a  standard  test  is  to  give  the  teacher  in- 
formation concerning  her  class  and  its  individual  needs.  Al- 
though it  is  necessary  to  have  reproduction,  oral  or  written,  in  most 
branches  of  the  curriculum  of  the  upper  grades  as  a  means  of 
judging  whether  the  pupil  has  learned  the  lesson  assigned,  as  a 
basis  for  standard  tests  it  will  probably  never  be  practical.  Such 
a  test  violates  two  important  rules  of  educational  measurement  in 
that  (a)  the  test  is  subjective  rather  than  objective  and  (b)  the 
task  of  correcting  results  is  prodigious. 

On  the  other  hand,  answers  to  carefully  selected  questions 
jdeld  as  good  a  measure  of  pupils'  ability  to  read  as  does  repro- 
duction, and  the  answers  are  easier  to  score. 
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In  spite  of  these  objections,  however,  there  are  certain  advan- 
tages in  giving  such  a  test,  for  it  reveals  that: 

1.  Teachers  cannot  be  depended  upon  to  decide  accurately 
whether  a  selection  is  difficult  or  not — This  should  make  teachers 
more  lenient  in  their  criticisms  of  the  results  of  the  pupils'  study 

2.  It  is  the  relation  between  words,  phrases,  and  sentences 
which  makes  the  difficulty  rather  than  the  meanings  of  the  indi- 
vidual words,  phrases,  and  sentences 

3.  There  will  be  certain  ideas  in  the  selection  that  very  few 
pupils  will  be  able  to  reproduce — These  may  be  important  or  not 

4.  The  pupil  will  draw  very  largely  upon  his  experience  and  not 
be  bound  down  by  what  he  has  just  read.  This  gives  the  teacher 
a  clue  as  to  how  corrective  material  should  be  used. 


THE  USE  OF  PSYCHOLOGICAL  TESTS  IN  THE  EDUCA- 
TIONAL GUIDANCE  OF  HIGH-SCHOOL  PUPILS 

W.  M.  Proctor 

Leland  Stanford  Junior  University 

In  a  previous  article^  the  writer  has  shown  that  there  is  a  very 
close  relationship  between  intelligence  level  and  the  elimination 
of  pupils  from  high  school.  There  are  good  grounds  for  the  pre- 
diction that  75  percent  of  those  who  test  below  average,  mentally, 
will  fail  in  more  than  one-half  of  their  studies  during  their  first  year 
of  high  school;  that  50  percent  of  them  will  leave  school  to  go  to 
work  during  the  first  two  years;  and  that  none  of  them  will  remain 
to  graduate.  The  members  of  this  group  demand  special  atten- 
tion. If  they  are  not  carefully  guided  in  the  selection  of  their 
high-school  work  many  of  them  will  fail  in  all  of  their  subjects 
during  the  first  semester,  with  elimination  as  the  inevitable  result. 

Heretofore  we  have  acted  upon  the  assumption  that  the  only 
way  to  discover  the  capabilities  of  high-school  pupils  was  to  per- 
mit them  to  try  themselves  out  in  various  subjects  of  the  high- 
school  curriculum.  It  has  even  been  a  common  practice  to 
require  all  first-year  high-school  pupils  to  take  an  abstract  subject 
like  algebra.  Thus  many  a  promising  educational  bark  has  gone 
down  on  the  uncharted  rocks  of  the  first-year  high-school 
subjects. 

Experimentation  with  psychological  tests  has  now  reached  a 
stage  where  we  can  begin  to  hope  that  this  wasteful  trial  and  error 
method  of  procedure  is  to  be  discarded  for  a  more  scientific  plan 
of  educational  guidance.  No  tests  have  yet  been  devised,  either 
mental  or  pedagogical,  which  enable  the  adviser  to  chart  unerr- 
ingly the  educational  possibilities  of  a  given  youth,  but  we  have 
made  sufficient  progress  in  the  science  of  mental  measurements 
to  be  able  to  estimate  with  approximate  accuracy  the  probable 
school  success  of  a  given  pupil.  The  results  of  a  practical  experi- 
ment in  educational  guidance  by  means  of  mental  tests  will  be 
described  in  the  following  pages. 

*  Proctor,  W.  M.,  "Psychological  tests  as  a  means  of  measuring  the  probable 
school  success  of  high-school  pupils,"  Journal  of  Educational  Research,  1:258-70, 
April,  1920. 
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FIGURE   1. — ILLUSTRATING  DISTRIBUTION  OF  SA^  PUPILS  BY  I.   Q.'s 
AND  CHRONOLOGICAL  AGES 
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1.  Conditions  surrounding  the  experiment. — The  mid-year  8  A 
class  of  the  Palo  Alto  Intermediate  School  comprising  31  pupils, 
was  examined  with  the  Stanford-Binet  Scale  in  January,  1918. 
Figure  1  shows  the  distribution  of  intelligence  quotients  by  chron- 
ological age  groups.  There  were  twelve  thirteen-year-old  pupils, 
eight  fourteen-year-old,  seven  fifteen-year-old,  and  four  sixteen- 
year-old  pupils  examined.  The  lowest  I.  Q.  discovered  in  the 
thirteen-year-old  group  was  110.     All  of  the  thirteen-year-olds 

*  In  grade  designations  "A"  means  "second  lialf." 
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were,  therefore,  accelerated  mentally.  None  of  the  fourteen-year- 
old  group  fell  below  95  I.  Q.  They  were  all  at  or  above  age  men- 
tally. One  fifteen-year-old  had  an  I.  Q.  of  90  and  would  be  listed 
as  "below  average"  in  intelligence.  Of  the  four  sixteen-year-old 
pupils,  all  of  whom  would  be  accounted  chronologically  retarded, 
three  had  I.  Q.'s  of  88,  and  one  an  I.  Q.  of  96.  That  is  to  say,  one 
of  the  sixteen-year-olds  was  normal  and  three  would  rate  as  "dull- 
normal." 

Of  the  31  members  of  the  8 A  class,  22  entered  the  Palo  Alto 
High  School  in  February,  1918.  Four  members  of  the  class 
entered  secondary  schools  elsewhere,  two  entered  business  colleges, 
two  went  to  work,  and  one,  a  girl  with  an  I.  Q.  of  88,  eloped  with 
a  soldier  from  a  nearby  encampment. 

Only  four  members  of  this  8A  class  had  earned  I.  Q.'s  below  95. 
One  of  these,  as  just  indicated,  did  not  enter  high  school.  The 
remaining  three  entered  high  school,  but  two  of  them  dropped  out 
before  the  end  of  the  first  year.  The  percentage  of  elimination 
from  the  class  of  those  who  tested  below  95  I.  Q.  was  therefore 
75.0,  The  one  who  remains  in  high  school  is  making  an  average 
record  in  scholarship.  She  made  a  rating  of  "average"  on  an 
Army  Scale  test  given  a  few  weeks  later,  and  has  shown  herself 
capable  of  diligent  application  to  her  school  work. 

Each  member  of  the  class  was  questioned  as  to  his  or  her  voca- 
tional ambition,  educational  plans,  and  the  subjects  which  he  or 
she  would  like  to  take  up  during  the  first  year  of  high  school. 
These  data,  as  well  as  results  attained  in  Stanford-Binet  and 
Army  Scale  mental  tests,  were  recorded  on  cards. 

2.  Use  made  of  information  gathered. — The  cooperation  of  the 
vice-principal  and  entering  class  adviser  was  obtained  in  order 
that  the  members  of  the  8A  class  might  receive  intelligent  educa- 
tional guidance  when  they  entered  the  high  school.  Duplicate 
sets  of  cards  were  prepared  for  the  use  of  these  persons.  On 
registration  day  all  the  newly  entered  8A  graduates  were  referred 
to  the  vice-principal  or  the  class  adviser  for  help  in  making  out 
their  curriculums.  No  one  was  permitted  to  file  a  study  card 
without  this  conference. 

Following  are  samples  of  the  cards  used  in  this  experiment  in 
educational  guidance.  The  only  change  from  the  original  is  in  the 
case  of  the  name. 
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CARD  NO.  1 

Smith,     Jane  chronological  age: 

13  yrs . ,    9   mo  . 

Score  Army  Scale.  .  .151       Stanford-Binet  mental  age: 
Army  Scale  mental  age:  16    JTS  .  ,     3    mO  . 

17  yrs . , 5  mo . 

Army  Scale  I.  Q 124      Stanford-Binet  I.  Q 118 

High  school  subjects  which      Educational  plans: 

pupil  desires  to  take:  To     finish,    high 

Sewing  school  and  take 

French  husiness  college 

History         course. 

Typewriting  Vocational  ambition:  To   be 

Piano  a  stenographer  or 

"bookkeeper. 

Grade  of  work  done  in  intermediate  and  grammar  schools: 

"B"    and   "B+" 

Comment    of  Examiner:     If   assigned    tO    al- 
gebra  can   safely  he   placed   in 
first    "rapid  progress"   division. 

Jane  Smith  was  advised  to  take  subjects  that  would  make  it 
possible  for  her  to  go  on  to  college  as  well  as  to  carry  out  her 
ambition  to  become  a  stenographer.  She  took  up:  English 
German,  algebra,  and  typewriting.  During  the  first  semester  of 
her  high-school  course  she  made  an  average  of  "B"  in  all  of  her 
subjects. 

Card  No.  2  relates  to  Mary  Jones  who  took  exactly  the 
subjects  outlined  on  her  card,  except  that  being  a  first-year 
pupil  she  was  permitted  to  take  four  subjects  only  and  had  to 
wait  until  her  second  year  for  drawing.  At  the  end  of  the  first 
semester  in  high  school  she  had  earned  three  "A"  grades  and  a 
"B-f,"  with  an  average  of  93  percent. 

Here  was  the  case  of  a  girl  with  very  superior  ability  as  indicated 
by  two  different  mental  examinations,  by  her  school  record  and  by 
the  estimates  of  her  elementary  and  intermediate  school  teachers. 
She  gave  evidence  of  being  an  independent  thinker,  of  knowing 
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Jones,    Mary 

Score  Army  Scale.  .  .  148 
Army  Scale,  mental  age: 

17  yrs . ,    2  mo  . 

Army  Scale  I.  Q.  •  .  -131 


Chronological  age:  13  yrS  . , 

1  mo . 

Stanford-Binet  mental  age: 

17   yrs . ,    2  mo . 


Stanford-Binet  I.  Q 131 


High  school  subjects  which 
pupil  desires  to  take: 

English 
Alge"bra 
Latin 
History 
Drawing 


Educational  plans: 

To  finish  high 
school  and  attend 
a  university  or 
normal  school. 

Vocational    ambition :    T  0 

become  a  drawing 
teacher. 


Grade  of  work  done  in  grammar  and  intermediate  schools :      A 
Comment  of  Examiner:  Knows    JUSt    where    she 

is  going  and  how  to  get  there. 
May  safely  be  permitted  to  select 
her  own  course  of  study.   Assign 
to  first  division  in  algebra. 

just  what  she  wanted  to  make  of  herself,  and  just  what  she  would 
have  to  do  by  way  of  preparation.  The  necessity  for  educational 
and  vocational  guidance  in  her  case  might  well  be  questioned. 
However,  it  was  a  real  advantage  to  her  teachers  to  know  at  the 
very  beginning  of  her  high-school  career  the  quality  of  her  ability 
and  something  of  her  life  plans  in  order  that  they  might  give 
immediate  and  sympathetic  cooperation.  Without  this  knowl- 
edge they  might  have  made  the  mistake  of  holding  her  back  to  the 
pace  of  the  "average"  pupil.  Fortified  by  the  facts  relative  to  her 
mental  gifts  and  vocational  ambitions,  she  is  to  be  permitted  to 
complete  her  high-school  course  in  three  years. 

There  is  just  as  much  danger  that  the  bright  pupil  will  not  be 
given  enough  to  do,  as  that  the  dull  pupil  will  be  giyen  tasks  that 
are  too  difl&cult  to  perform. 
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CARD  NO.  3 

Roe,     Richard  Chronological  age:  14  yrs., 

4  mos . 

Score  Army  Scale...  150      Stanford-Binet  mental  age: 
Army  Scale  mental  age:  16    yrs.     9    mO. 

17   yrs  .  ,   4  mo  . 

Army  Scale  I.  Q 120      Stanford-Binet  I.  Q. 117 

High  school  subjects  which      Educational  plans: 

pupil  desires  to  take:  To    finish    high 

English  school  then  at- 

History  tend  a  university 

Algetra  or  the  U.  S. 

French  naval  academy. 

Vocational  ambition:  Chemi- 
cal engineer  or 
naval  officer. 

Grade  of  work  done  in  elementary  and  intermediate  schools: 

Very  poor.  Estimated  as  "average" 
\)j   some  grade  teachers,  and  as 
"TdoIow  average"  "by  others. 

Comment  of  Examiner:  Boy    has    ahility   hut 

needs  to  "be  waked  up.   Suggest 
that  he  take  general  science  in 
place  of  history  for  first 
year.   Also  suggest  that  he  "be 
placed  in  first  division  in  alge- 
"bra  where  he  will  have  to  work. 
He  will  need  to  develop  ability 
in  both  science  and  mathematics  if 
he  is  to  follow  his  vocational 
ambition. 

The  boy  whose  card  is  set  forth  above  enrolled  for  English, 
algebra,  history,  and  general  science,  upon  entering  high  school. 
During  his  first  half  year  he  made  grades  of  "C"  in  English,  and 
"B"  in  each  of  his  other  subjects.  This  was  a  great  improvement 
over  the  grades  earned  by  him  in  the  eighth  grade.     A  recent 
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checking  up  shows  that  he  has  brought  up  his  English  grade  and 
is  maintaining  college  recommendation  standing  in  all  his  work. 
The  mental  tests  were  an  aid  to  his  advisers  in  discovering  how  to 
spur  him  on  to  creditable  achievement  in  his  school  work. 

CARD  NO.  4 

Brown,    Carrie         chronological  age:  15  yrs  . , 

Score  Army  Scale. . .  100  7    mO  . 

Army  Scale  mental  age:  Stanford-Binet  mental  age: 

14  yrs.,  0  mo.,  14  yrs.  ,    2  mo . 

Army  Scale  I.  Q 89        Stanford-Binet  I.  Q 90 

High  school  subjects  which 

pupil  desires  to  take:  Educational  plans: 

English  To  go  to  Mills 

Algebra  College 

Latin  Vocational  ambition:  To    \)Q 

Typing  a  Chemist. 

Drawing 

Grade  of  work  done  in  intermediate  and  grammar  schools: 

Grades  in  8A  class  only  fair,  even 
in  work  that   is  "being  repeated. 
Estimates  of  elementary  and  inter- 
mediate teachers:  "slow"  "but 
a  conscientious  worker. 

Comment  of  Examiner:     Should    "be    diSCOUr- 

aged  as  to  taking  Latin.   Algehra 
dou"btful,  "but  if  she  insists  in 
view  of  desire  to  go  to  college, 
assisn  to  second  division. 


The  program  finally  worked  out  by  Carrie  Brown  and  the  class 
adviser  included  English,  algebra,  free-hand  drawing,  and  typing. 
Her  grades  at  the  end  of  the  first  semester  in  high  school  were: 
EngHsh,  "C";  algebra,  "E"  (failure);  free-hand  drawing,  "C"; 
typing,  "B."  She  had  failed  in  algebra,  the  subject  counted  as 
doubtful  by  the  examiner,  and  had  earned  less  than  college  recom- 
mendation grades  in  the  only  other  subjects  that  would  be  counted 
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toward  entrance  to  Mills  College.  Even  if  she  completes  high 
school  her  chance  of  continuing  in  college  is  not  at  all  bright. 

A  sufficient  number  of  sample  cards  have  been  described  to 
illustrate  the  method  employed.  There  was  no  coercion.  Counsel 
and  advice  in  the  selection  of  subjects  were  all  that  was  attempted, 
but  the  counsel  and  advice  offered  were  based  on  all  the  signi- 
ficant information  with  regard  to  mental  ability,  school  success, 
vocational  ambition,  and  teachers'  estimates  of  ability,  that  could 
be  obtained.  Certain  pupils  elected  to  take  subjects  which  the 
advisers  felt  sure  they  would  fail  in  and  made  passing  grades. 
Others  taking  subjects  on  the  advice  of  the  counselors  failed. 
Such  cases  simply  illustrate  the  truth  that  no  human  agency,  how- 
ever fortified  with  information  or  however  careful  to  mix  common 
sense  with  theories,  can  hope  to  be  infallible.  The  general  results 
of  the  experiment,  however,  were  very  satisfactory. 

3.  Results  attained  by  ^'guided"  and  "unguided''  high-school 
pupils. — The  original  group  of  107  high-school  pupils  which  en- 
tered the  Palo  Alto  High  School  in  September  1916,  were  examined 
with  the  Stanford-Binet  Scale  after  entering  high  school.  They 
had  already  selected  their  courses  of  study  at  the  time  of  being 
examined,  hence  can  properly  be  designated  as  "the  unguided" 
group.  A  comparison  of  the  first  year's  work  done  by  the  mem- 
bers of  the  "unguided"  group  with  the  work  done  by  the  group 
that  entered  high  school  in  February,  1918,  and  which  had  the 
benefit  of  counsel  based  on  mental  tests  and  other  significant 
data,  will  illustrate  the  value  of  careful  guidance  as  against  the 
trial  and  error  method  of  selecting  high-school  courses  of  study. 


TABLE  I.      COMPARATIVE  FACTS  REGARDING  "GUIDED" 
AND  "unguided"  GROUPS  OF  HIGH-SCHOOL  PUPILS 

Group 

Out  at 
Work 

Per- 
cent 

Out  by 
Transfer 

Per- 
cent 

Failed 
1  Subject 

Per- 
cent 

Failed 
2  or  More 

Per- 
cent 

Guided.... 
Unguided . . 

1 

13 

4.5 
12.0 

2 
14 

9.0 
13.0 

4 
33 

18.0 
31.0 

0 
11 

0.0 
10.0 

It  is  not  exactly  true  to  fact  to  designate  the  original  group  of 
107  as  the  "unguided"  group.  Most  of  them  had  been  examined 
with  the  Stanford-Binet  before  the  end  of  the  first  six-week  period. 
Whenever  the  results  of  the  first  six  weeks  of  school  work  con- 
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firmed  the  indications  of  the  mental  tests  that  a  pupil  would  prob- 
ably fail  in  such  abstract  subjects  as  algebra,  Latin,  etc.,  that 
pupil  was  permitted  to  drop  the  subject  and  continue  the  semester 
carrying  but  three  subjects.  The  subject  dropped  at  the  end  of 
the  first  six-week  period  was  not  counted  as  a  failure  in  compiling 
the  data  for  Table  I.  The  mental  tests  were  utilized  to  aid  in 
correcting  the  mistakes  made  by  the  pupils  in  the  unguided  selec- 
tion of  their  subjects.  To  this  extent,  then,  the  original  group 
was  guided,  but  the  guidance  came  after,  not  before  school  work 
was  begun. 

The  number  of  failures  registered  against  the  "unguided"  group 
at  the  end  of  their  first  year  in  high  school  would  undoubtedly  have 
been  greatly  increased  if  it  had  not  been  for  the  limited  guidance 
above  described.  This  fact  gives  greater  significance  to  the  data 
presented  in  Table  I. 

The  median  I.  Q.  of  the  unguided  group  was  105,  and  themedian 
I.  Q.  of  the  guided  group  was  108,  a  difference  of  three  points  in 
favor  of  the  guided  group,  but  this  is  not  in  itself  an  adequate 
explanation  of  the  superior  record  made  by  the  guided  group  dur- 
ing its  first  year  in  high  school. 

The  most  significant  facts  to  be  found  in  Table  I  are  those  relat- 
ing to  number  of  failures  in  one  subject,  and  in  two  or  more 
subjects.  It  appears  that  31.0  percent  of  the  unguided  group 
failed  in  one  subject,  and  11.0  percent  failed  in  two  or  more  sub- 
jects during  their  first  year  in  high  school,  while  of  the  guided 
group  only  18.0  percent  failed  in  one  subject  and  none  of  them 
failed  in  two  subjects  Since  it  has  been  shown  that  failures  in 
school  work  tend  to  increase  the  percentage  of  elimination  it  is 
reasonable  to  attribute  the  small  percent  of  elimination  due  to 
leaving  high  school  to  go  to  work,  in  the  case  of  the  guided  group, 
to  entire  absence  of  failures  in  two  or  more  subjects. 

The  results  of  the  above  described  experiment  in  educational 
guidance  by  means  of  mental  tests  would  seem  to  justify  the  con- 
clusion that  such  tests  may  be  of  material  assistance  to  the  high- 
school  administrator,  if  used  in  connection  with  other  significant 
data.  It  is  certain  that  the  methods  applied  in  this  instance,  if 
employed  in  any  high  school,  would  prove  greatly  superior  to  the 
wasteful  "trial  and  error"  methods  that  now  prevail. 

4.  Relation  of  general  level  of  intelligence  to  success  in  a  given 
subject. — In  Table  II  is  shown  the  correlation  between  general 
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level  of  intelligence  and  high-school  grades  in  algebra.  The 
algebra  grades  are  recorded  under  the  letters  A,  B-f ,  B,  C,  C— , 
D,  and  E.  The  I.  Q.'s  come  under  the  groups  84-89,  90-94, 
95-99,  etc. 

TABLE  II.      CORRELATION  BETWEEN  I.  Q.'s  AND  GRADES 
IN  ALGEBRA  OF  113  HIGH-SCHOOL  PUPILS 


Algebra 

LQ.' 

s  (Stanford-Binet) 

Grades 

80- 
84 

85- 
89 

90- 
94 

95- 
99 

100- 
104 

105- 
109 

110- 
114 

115- 
119 

120- 
124 

125- 
over 

Totals 

"A" 

2 

1 

3 

0 
1 

7 
5 

1 
2 
5 
3 

1 

2 
5 
3 

3 
5 
2 
3 
1 

11 

"B+" 

10 

"B" 

2 

1 

2 
4 

3 

5 
1 
2 
3 

7 
6 

1 

3 
2 

1 
1 
1 

36 

"C" 

32 

"C-" 

3 

"D" 

1 
3 

5 

1 
2 

6 

"E" 

1 

15 

Totals 

1 

7 

11 

16 

15 

11 

16 

11 

11 

14 

113 

Correlation  (Pearson) :  0.46 
Probable  error:  0.05 

The  correlation  obtained,  0.46,  which  is  nine  times  the  prob- 
able error  can  be  counted  as  having  considerable  significance.  An 
examination  of  the  data  contained  in  Table  II  will  show  that 
twelve  of  the  fifteen  failures  in  algebra,  or  80.0  percent  of  the  total 
number  of  failures,  were  earned  by  pupils  with  I.  Q.'s  below  100. 
There  were  35  pupils  having  I.  Q.'s  below  100,  and  26  of  them,  or 
74.3  percent  earned  marks  below  "B,"  which  is  the  college  recom- 
mendation grade  in  California.  On  the  other  hand  there  were  78 
pupils  with  I.  Q.'s  above  100,  and  45  of  these,  or  63.0  percent, 
earned  marks  of  "B"  or  above.  An  I.  Q.  of  120  or  over  denotes 
very  superior  intelligence.  There  are  25  cases  with  I.  Q.'s  120  or 
over  in  Table  II.  All  of  these  succeeded  in  earning  passing  grades 
in  algebra.     Only  one  received  a  mark  as  low  as  "C  — ." 

High-school  statistics  show  that  algebra  is  responsible  for  more 
failures  of  first-year  pupils  than  any  other  subject.  Table  II 
suggests  that  probable  success  or  failure  in  algebra  can  be  inferred 
from  the  general  level  of  intelligence  as  disclosed  by  mental  tests. 
It  follows  that  the  high  percentage  of  failure  in  algebra  could  be 
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materially  reduced  if  only  those  were  encouraged  to  take  the  sub- 
ject whose  general  level  of  intelligence  measured  up  to  average  or 
better. 

5.  Relation  of  score  in  a  particular  mental  test  to  success  in  a 
given  high-school  subject. — Test  No.  9,  in  Army  Scale,  Group 
Examinations  a  and  h,  is  a  "word  relations"  test.  It  involves  a 
knowledge  of  word  meanings  and  also  the  ability  to  use  words 
intelligently  in  their  proper  relations  to  one  another.  Table  III 
compares  the  scores  made  by  171  first-year  pupils  of  the  Palo  Alto 
High  School  in  Test  No.  9,  with  the  grades  made  by  the  same 
pupils  in  English  during  their  first  high-school  year. 

The  directions  for  giving  the  test  are  as  follows : 

In  each  of  the  lines  below,  the  first  two  words  have  a  certain  relation.  Notice 
that  relation  and  draw  a  line  under  the  one  word  in  the  parenthesis  which  has  that 
particular  relation  to  the  third  word.  Begin  with  No.  1  and  mark  as  many  sets  as  you 
can  before  time  is  called. 

Sample  sets  are  then  given  by  the  examiner  to  illustrate  what 
is  wanted: 

sky — blue:  grass — (grow,  green,  cut,  dead) 
fish — swims:  man — (boy,  woman,  walks,  girl) 
day — night:  white — (red,  black,  clear,  pure) 

TABLE    in.      CORRELATION    BETWEEN    GRADES    IN    ENGLISH    AND 

SCORES  IN  GROUP  INTELLIGENCE  TEST  NO.  9  OF 

ARMY  SCALE,  OF  171  HIGH-SCHOOL  PUPILS 


Marks  in 

Scores  in  Test  No.  9,  Examinations  a  and  b 

First  Year 
English 

1- 

4 

5- 
9 

10- 
14 

15- 
19 

20- 
24 

25- 
29 

30- 

34 

35- 
39 

40 

Totals 

"A" 

1 

1 

5 

17 

4 
7 

16 
17 

1 
1 

1 

14 

19 

8 

1 

3 

10 
13 

6 

2 
2 
6 
2 

11 

"B-1-" 

1 
1 
9 

35 

"B" 

60 

"C" 

3 

62 

"D"         

2 

"E" 

1 

Totals 

3 

11 

24 

46 

43 

32 

12 

171 

Correlation  (Pearson) :  0.48 
Probable  error:  0.04 

There  were  forty  sets  of  words  and  the  time  allowed  was  three 
minutes.    For  purposes  of  tabulation  the  scores  made  by  the 
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pupils  are  grouped:  1-4,  5-9, . . .  35-39,  40-.  The  English  grades 
are  indicated  by  the  letters  A,  B  +  ,  B,  C,  C  — ,  D  and  E, 

The  correlation,  0.478,  is  twelve  times  the  probable  error  and 
indicates  that  a  good  score  in  the  "word  relations"  test  is  a  fairly 
good  index  of  ability  in  first-year  high-school  English.  The  marks 
in  English  were  the  final  year  marks,  which  represent  the  minimum 
of  "D's"  and  "E's,"  because  all  conditions  and  failures  had  been 
removed  that  could  be  made  up.  The  median  score  in  Test  No.  9, 
was  26,  hence  scores  of  30  or  over  could  be  considered  superior. 
There  were  44  pupils  who  made  scores  of  30  or  over,  and  36  of  these 
or  82.0  percent  made  marks  in  first-year  English  of  "B"  or  above. 
Of  the  89  who  made  scores  of  from  20  to  29  inclusive,  68.7  percent 
made  marks  in  first-year  English  of  "B"  or  above.  While  of  the 
38  who  made  scores  of  from  one  to  nineteen  inclusive,  only  23.7 
percent  made  marks  of  "B"  or  above. 

Stated  in  terms  of  recommendation  for  college  the  above  analy- 
sis of  the  data  of  Table  III  means  that  76.3  percent  of  the  high- 
school  pupils  whose  ability  in  word  relations  is  represented  by  a 
score  of  less  than  20  fail  to  secure  a  college  recommendation  grade, 
while  only  18.0  percent  of  those  who  attain  a  score  of  30  or  over  in 
the  same  test  fail  to  secure  such  a  grade. 

These  results  seem  to  indicate  that  a  series  of  tests  involving 
the  fundamental  traits  of  mind  essential  to  the  successful  study  of 
English  could  be  devised.  But  there  are  so  many  mental  traits 
involved  in  the  mastery  of  the  subject  of  EngHsh  that  a  series  of 
tests  bringing  into  play  all  those  traits  would  undoubtedly  be 
found  to  be  a  good  test  of  general  intelligence  as  well  as  a  test  of 
specific  ability  in  English. 

Summary  and  Conclusions 

1.  The  results  of  an  experiment  in  educational  guidance,  in 
which  all  the  members  of  an  8A  class  about  to  enter  high  school 
were  given  mental  tests  and  advised  with  reference  to  their  first 
year  high-school  work,  proved  very  satisfactory.  Compared  with 
an  unguided  group  it  was  found  that  while  31  percent  of  the  un- 
guided  group  failed  in  one  subject,  and  11  percent  failed  in  two 
subjects  during  their  first  high-school  year,  only  18  percent  of  the 
guided  group  failed  in  one  subject  and  none  of  them  failed  in  two 
subjects.     The  mental  tests  aided  in  the  discovery  of  the  pupil's 
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general  level  of  intelligence,  made  possible  the  giving  of  sound 
educational  advice  at  the  time  when  it  would  do  the  most  good, 
and  thus  tended  to  reduce  the  percentage  of  failure  and 
elimination.  The  methods  employed  can  be  adapted  to  the 
needs  of  any  high  school. 

2.  The  general  level  of  intelligence  is  shown  to  have  real  signif- 
icance as  a  means  of  predicting  success  in  a  particular  subject, 
such  as  algebra.  In  Table  II  it  was  shown  that  100  percent  of 
those  having  I.  Q.'s  of  120  or  over  passed  in  their  algebra,  while 
40  percent  of  those  with  I.  Q.'s  below  100  either  failed  or  were  con- 
ditioned in  algebra,  and  only  20  percent  of  the  members  of  this 
group  earned  college  recommendation  grades.  The  general  level 
of  intelligence  could  be  relied  upon  as  a  means  of  selecting  those 
who  would  be  most  likely  to  succeed  in  algebra  and  kindred  sub- 
jects. 

3.  Success  in  a  particular  test  of  a  series  may  be  a  fairly  reliable 
index  of  success  in  a  high-school  subject  involving  the  mental 
traits  supposed  to  be  measured  by  the  test  in  question.  High 
scores  in  the  "word-relations"  test  of  the  Army  Scale,  Examina- 
tions a  and  h,  correspond  generally  to  high  marks  in  first-year 
high-school  English,  while  scores  below  twenty  in  the  same  test 
correspond  generally  to  low  marks  in  the  same  subject. 

4.  Mental  tests  for  purposes  of  prognosis  in  individual  high- 
school  subjects  such  as  algebra,  English,  etc.,  could  no  doubt  be 
devised.  But  the  mastery  of  any  high-school  subject  involves 
such  a  complex  of  mental  traits  that  any  test  which  proves  to  be  a 
good  test  of  ability  to  succeed  in  one  subject  is  quite  apt  to  be 
found  a  good  test  of  general  mental  ability.  It  has  already  been 
shown  that  a  high-school  pupil  having  a  high  level  of  intelligence 
will  probably  succeed  in  all  of  his  subjects,  and  conversely  that 
a  pupil  having  a  low  level  of  intelligence  is  apt  to  fail  in  most  of  his 
high-school  subjects.  The  best  way,  therefore,  in  which  to  arrive 
at  an  estimate  of  a  given  pupil's  probable  success  in  a  specific  high- 
school  subject  is  to  discover  the  general  level  of  his  intelligence. 
It  follows  that  standardized  mental  tests  may  render  invaluable 
service  in  the  educational  guidance  of  high-school  pupils.  Partic- 
ularly will  this  be  found  to  be  true  if  the  results  of  the  mental  test 
are  interpreted  in  the  light  of  other  significant  data,  such  as 
school  marks  made  in  previous  grades,  teachers'  estimates  of 
ability,  and  educational  and  vocational  plans. 


THE  OPERATION  OF  BUREAUS  OF  EDUCA- 
TIONAL RESEARCH— WITH  PARTICULAR 
REFERENCE  TO  WISCONSIN 

W.  W.  Theisen 
Siate  Department  of  Public  Instruction,  Madison,  Wisconsin 

A  remarkable  development  in  scientific  methods  of  studying 
educational  problems  has  taken  place  within  the  past  few  years — 
a  development  which  has  made  it  possible  for  well-informed 
persons  to  know  more  fully  and  accurately  than  ever  before  the 
possibiHties  and  limitations  of  educational  improvement. 

The  evidence  of  this  development  may  be  found  in  many 
types  of  material,  e.g.,  in  numerous  published  surveys,  school 
reports,  reports  of  educational  conferences,  bulletins  of  bureaus 
of  research,  scores  of  recent  educational  monographs,  and  hun- 
dreds of  magazine  articles.  Our  methods  of  treatment  of  the 
statistics  of  attendance,  progress  and  promotion,  courses  of  study, 
teaching  personnel,  buildings  and  equipment,  and  finance  have 
been  greatly  improved;  while  more  noteworthy  than  any  other 
has  been  the  advance  in  the  technic  of  measuring  the  achieve- 
ments of  pupils. 

Unfortunately,  however,  the  utilization  of  these  scientific 
methods  is  still  far  from  common  in  school  practice.  Moreover, 
the  knowledge  of  what  has  been  done  and  can  be  done  in  educa- 
tion is  still  largely  the  possession  of  a  few.  The  problem  now  is 
to  make  these  methods  and  this  knowledge  widely  available  and 
practically  effective.  To  accompUsh  this  the  results,  methods, 
and  spirit  of  investigation  must  be  put  into  operation  in  every 
school. 

The  so-called  bureau  of  research  is  the  most  active  and 
effective  agency  today  for  making  these  newer  developments  a 
part  of  our  practice.  Without  the  intelligent  direction  and 
supervision  of  such  an  agency,  teachers  and  administrators  will 
not  benefit  to  the  fullest  extent  from  our  advance  in  scientific 
methods.  Scientific  supervision  of  this  sort  enables  the  weak 
schools  to  gain  strength  and  the  strong  to  grow  still  stronger; 
makes  the  successful  activities  of  one  school  available  for  others; 
and   develops   teamwork  among  schools.     Incomparably  more 
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effective  are  the  united  efforts  of  such  schools  than  the  spasmodic 
efforts  of  single  schools.  It  is  the  function  of  bureaus  of  school 
research  to  provide  supervision  of  this  kind,  and  to  bring  about 
over  a  large  area  the  application  of  scientific  procedure  to  problems 
of  administration,  supervision,  and  teaching.  School  systems  that 
have  installed  research  bureaus  have  come  to  stand  out  in 
marked  contrast  with  others  that  have  failed  to  do  so. 

Measurement  of  Instruction  as  a  Bureau  Problem 

The  problems  that  should  command  the  attention  of  bureaus 
of  research  are  many.  One  of  the  most  important  is  the  problem 
of  applying  scientific  procedure  in  measuring  and  improving  the 
product  of  instruction.  At  present  only  a  comparatively  few 
principals  and  teachers  can  be  expected  to  proceed  unaided. 
Those  who  can,  will  nevertheless  lack  the  stimulation  which 
results  from  a  knowledge  of  the  success  of  others  in  wrestling  with 
the  same  problems.  The  need  of  supervision  of  educational  meas- 
urement in  this  restricted  sense  arises  from  another  source. 
Many  of  our  school  systems,  city  and  state,  are  deficient  in  the 
amount  of  helpful  supervisory  aid  which  they  can  give  to  teachers. 
Educational  measurement  furnishes  a  very  fruitful  instrument  of 
supervision.  With  a  comparatively  small  expenditure  of  money, 
a  large  number  of  schools  and  teachers  can  be  effectively  reached. 
This  fact  has  undoubtedly  had  its  influence  on  the  rapidity  with 
which  bureaus  of  educational  measurement,  or  research,  have 
developed.  Such  organizations  ought  soon  to  be  found  in  every 
state  and  in  every  city  of  large  or  moderate  size. 

Educational  measurement  on  a  large  scale  involves  the  co- 
operation of  superintendents,  principals,  and  teachers.  It  is 
the  task  of  bureaus  of  research  to  build  up  such  cooperation. 
To  secure  it  requires  well-directed  efforts  on  the  part  of  those  in 
charge  of  the  bureaus.  In  the  first  place,  it  should  be  assumed 
that  the  large  majority  of  superintendents,  principals,  and 
teachers  are  progressive  at  heart,  that  they  earnestly  desire  to 
know  how  they  can  improve  the  quality  of  instruction,  and  that 
they  will  decide  upon  a  wise  course  of  procedure,  if  the  facts  are 
clearly  presented.  Iji  the  second  place,  it  will  be  necessary  to 
make  a  clear  presentation  of  the  merits  and  possibiHties  of  educa- 
tional measurements,  and  in  doing  so  there  will  be  abundant 
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opportunity  for  the  employment  of  tact  and  good  judgment. 
Moreover,  the  supervisor  or  director  in  charge  must  maintain 
first-hand  contact  with  the  schools  through  field  work.  Without 
it  he  will  not  be  in  a  position  to  realize  the  possibilities  and 
limitations  of  local  schools  and  teachers,  nor  can  he  prescribe 
accurately  for  their  improvement.  This  is  exceedingly  important 
in  all  the  bureau  work  of  a  state  department  or  university. 

The  attitude  of  those  whom  the  director  hopes  to  reach  will 
depend  upon  their  previous  acquaintance  in  the  field  of  educa- 
tional investigation  and  measurement.  For  convenience  we  may 
divide  school  heads  and  teachers  into  three  groups:  Group  I: 
those  partly  acquainted  with  educational  measurements  and  their 
uses,  as  a  result  of  what  they  have  read  or  have  heard  on  various 
occasions;  Group  II:  those  wholly,  or  almost  wholly,  unfamiliar 
with  the  newer  developments  in  educational  investigation;  and 
Group  III:  those  who  have  had  considerable  experience  in 
their  application.  The  director's  efforts  to  stimulate  educational 
research  will  differ  in  each  of  these  cases. 

Group  I.    Those  Partly  Acquainted  with  Educa- 
tional Measurement 

Most  superintendents  even  in  states  which  do  not  support 
bureaus  of  research,  are  partly  acquainted  with  educational 
measurements  and  their  uses.  They  are,  therefore,  for  the  most 
part  in  a  receptive  mood.  Although  they  are  often  eager  to 
begin  actual  investigation,  they,  nevertheless,  hesitate  because 
of  unfamiliarity  with  the  details  of  procedure  and  lack  of  confi- 
dence in  their  own  ability.  In  such  cases,  the  presence  of  the 
supervisor  or  director  is  all  that  is  needed  to  set  the  movement 
on  foot. 

In  visits  to  schools  of  this  type,  the  director  must  adopt  a 
sympathetic  attitude.  He  must  endeavor  to  find  out  what  the 
schools  have  tried  or  are  trying  to  do.  By  so  doing  he  will  discover 
wherein  his  own  services  will  be  of  most  help.  Among  other 
things,  he  should  make  inquiry  as  to  the  superintendent's  plan 
for  the  professional  development  of  his  teaching  staff.  Again,  he 
should  learn  what  subjects  of  the  curriculum  are  being  attacked 
with  a  view  to  improving  instruction.  The  services  of  the  director 
will  usually  be  most  welcomed,  if  he  exhibits  a  desire  to  aid  in 
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carrying  out  the  superintendent's  plans.  With  this  point  as  a 
beginning  he  will  be  in  a  position  to  make  recommendations  for 
additional  lines  of  investigation. 

Where  such  schools  have  already  planned  to  make  some  appli- 
cation of  educational  measurements,  they  will  welcome  the 
director's  aid  and  guidance  in  the  details,  such  as  administering 
a  test,  and  scoring  and  tabulating  the  results.  While  we  do  not 
believe  that  much  of  his  time  should  be  spent  in  this  fashion,  such 
assistance  is  often  quite  necessary  in  new  fields.  As  far  as  possible, 
however,  his  time  should  be  given  to  interpreting  and  teaching 
others  how  to  interpret  the  results  attained,  assisting  teachers 
in  the  finer  diagnostic  analysis  of  results,  making  suggestions  for 
remedial  work,  and  planning  for  further  experimentation.  By 
all  means  he  should  make  it  a  point  to  meet  teachers  and  princi- 
pals individually  and  in  groups.  The  findings  and  suggestions 
can  then  be  made  the  subject  of  discussion.  It  is  very  important 
that  teachers  be  made  to  feel  that  their  use  of  measurements  must 
not  stop  with  a  compilation  of  results,  and  it  is  at  this  point  that 
the  services  of  the  director  are  most  needed.  Without  construc- 
tive guidance  much  well-intentioned  effort  is  apt  to  count  for 
naught. 

Where  the  supervisor  or  director  finds  it  impossible  to  be 
present  in  person,  he  can  assist  materially  through  correspondence. 
When  he  is  asked  for  information  on  such  matters  as  school 
building  standards,  grading  and  promotion  standards,  available 
tests  in  various  subjects  and  suggestions  as  to  their  use,  he  is  in 
a  position  to  help  superintendents  or  principals  to  proceed  wisely 
and  to  steer  them  away  from  pitfalls.  In  the  case  of  tests,  he 
should  ask  in  each  instance  that  a  copy  of  the  results  be  sent  him 
for  examination  and  criticism. 

Group  II.  Those  Unacquainted  with  Educational 
Measurement 
Every  director,  particularly  in  a  new  field,  must  expect  to  find 
some  superintendents,  principals,  and  teachers  who  are  to  all 
intents  unacquainted  with  educational  measurements  and  their 
significance.  He  should  endeavor  to  reach  as  many  of  these  as 
possible,  thus  recruiting  the  ranks  of  those  better  acquainted  with 
the  field.  There  are  several  avenues  and  instruments  of  approach 
that  can  be  used  to  good  advantage,  e.g.,  conventions  of  superin- 
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tendents  and  principals,  teachers'  institutes  and  other  educational 
gatherings  and  the  columns  of  state  educational  publications. 

The  most  fruitful  reward  of  effort  in  this  direction  results,  as 
before,  from  personal  visitation.  This  ofifers  opportunity  to 
"talk  things  over,"  to  tell  what  has  been  done  elsewhere,  to  show 
samples  of  standard  tests,  to  tell  how  they  may  be  used,  to  point 
out  their  merits  and  demerits,  to  indicate  the  benefits  to  be  gained 
from  their  application,  and  to  suggest  lines  of  investigation.  If 
this  part  of  the  work  is  well  done,  it  will  usually  result  in  an 
invitation  to  undertake  some  experimentation,  to  supply  some 
standardized  tests,  or  possibly  to  meet  with  the  teachers  and  ex- 
plain to  them  the  uses  of  such  tests.  New  bureaus  will  find  this 
type  of  field  work  advisable  whenever  it  is  at  all  possible. 

Group  III.    Those  Experienced  in  Educational 
Measurement 

In  schools  that  have  already  made  more  or  less  use  of  scientific 
methods  of  attacking  educational  problems,  the  director's  efforts 
can  be  centered  upon  an  analysis  of  some  of  the  results  and  their 
implications.  It  should  be  his  business  to  see,  for  example,  that 
the  diagnostic  phase  of  testing  is  properly  understood  and  empha- 
sized. It  will  be  a  part  of  his  task  to  demonstrate  from  the  actual 
papers  of  the  children  the  diagnostic  values  and  possibilities  of 
the  tests  used,  to  suggest  forms  for  tabulating  and  effectively 
representing  the  findings,  to  indicate  possible  needed  revisions 
in  teaching  method,  course  of  study,  or  gradation  of  pupils,  to 
propose  additional  equipment  in  the  way  of  books,  maps,  scales 
for  testing,  practice  materials,  etc.,  and  to  plan  lines  of  further 
research  and  experimentation.  Clearly,  the  director  should  be  a 
good  general  supervisor  of  instruction.  He  will  often  find  it 
impossible  to  give  each  school  all  of  the  personal  attention  it 
needs.  If,  however — as  in  a  state  department — there  are  general 
supervisors  of  instruction  at  work  out  in  the  field,  they  can  be 
instructed  and  enlisted  to  aid  in  carrying  out  remedial  measures 
in  local  schools.    Their  cooperation  will  be  extremely  valuable. 

Not  too  much  should  be  expected  of  schools  at  the  start.  In 
the  first  place,  it.is  not  advisable  to  attempt  many  lines  of  investi- 
gation in  a  given  school  system,  particularly  if  several  of  them 
affect  the  same  teachers.  When  standardized  tests  are  applied,  it 
is  well  to  confine  the  testing  to  one  subject  at  a  time.    Rarely 
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should  more  than  two  be  attempted  simultaneously.  If  too 
many  tests  are  undertaken,  confusion  results,  and  the  satisfactory 
treatment  of  any  one  of  them  is  difficult.  The  professional  ener- 
gies of  the  teaching  staff  should  be  organized  for  a  "drive"  on  the 
subject  chosen.  Not  until  its  objectives  have  been  reached  should 
other  subjects  be  attacked.  In  Wisconsin  it  has  been  the  practice 
in  most  instances  to  set  the  dates  for  successive  cooperative  tests 
so  that  a  period  of  two  months  or  more  may  intervene  between 
tests  in  different  subjects.  Arithmetic  may  be  tested  in  Novem- 
ber and  reading  in  February.  This  allows  the  teachers  and 
principals  some  time  to  work  out  remedial  measures.  If  we  may 
be  permitted  to  offer  a  criticism  upon  our  own  work,  it  is  that 
during  the  first  year  we  failed  to  allow  sufficient  opportunity  for 
this  sort  of  concentration.  In  the  second  place,  simple  tests 
should  be  selected  for  use  in  all  schools  that  have  had  no  previous 
experience  with  tests,  or  experience  of  a  very  limited  kind.  In 
such  schools,  the  many  administrative  details  connected  with 
the  more  elaborate  tests  only  serve  to  obscure  their  real  purpose. 

After  the  Work  Has  Been  Well  Started 
The  program  outlined  thus  far  has  to  do  with  the  initial 
building  of  a  foundation  for  educational  research.  After  a  group 
of  superintendents  has  been  trained  to  proceed  with  research 
and  experimentation,  the  work  of  the  director  becomes  somewhat 
different  in  character.  If  possible,  an  annual  conference  of  school 
heads  should  be  arranged.  A  number  of  states  now  hold  such 
conferences,  the  best  known  being  those  held  at  Indiana  Univer- 
sity. At  such  gatherings  the  results  of  previous  efforts  can  be 
reviewed.  Matters  for  cooperative  investigation  proposed  for 
the  year  can  be  discussed  and  voted  upon.  At  such  times  it  is 
the  business  of  the  director  to  bring  to  the  attention  of  the 
assembled  school  heads  the  most  recent  developments  in  scientif- 
ic procedure  in  education,  and  to  call  their  attention  to  the  best 
recent  literature  on  the  subject.  If  possible  at  this  time,  it  will 
be  well  to  bring  before  the  conference  some  prominent  workers 
in  the  field  of  educational  research  from  the  outside,  who  are 
capable  of  stimulating  further  educational  investigation  and 
professional  growth.  After  a  few  days  of  wholesome  discussion 
the  director's  suggestions  and  those  made  by  superintendents 
and  others  can  be  finally  considered  and  lines  of  investigation 
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voted  upon.  Superintendents  should  be  made  to  feel  that  the 
choice  is  their  own.  Dates  that  are  opportune  should  be  chosen. 
A  bureau  of  research  should  at  all  times  act  as  a  source  of 
information  for  teachers,  supervisors,  and  superintendents  on 
questions  relating  to  the  most  effective  methods  in  teaching, 
supervision,  or  administration.  A  part  of  its  function  is  to  sug- 
gest the  most  recent  studies  of  practical  value,  to  issue  reviews  of 
stimulating  and  suggestive  articles  and  monographs  in  the  field 
of  education,  and  to  send  out  bibliographies  of  the  best  publica- 
tions pertaining  to  problems  under  investigation. 

Educational  Measurement  in  Wisconsin 

Organized  work  in  educational  measurements  in  the  schools  of 
the  state  began  in  the  fall  of  1916  with  the  appointment  of  a 
director  of  educational  measurements  by  State  Superintendent 
C.  P.  Gary.  Previous  to  this,  the  efforts  to  carry  on  educational 
measurements  in  the  state  were  quite  meager  and  more  or  less 
spasmodic.  Since  then  a  definite  policy  of  cooperative  educa- 
tional investigation  of  school  conditions  has  been  pursued. 
Superintendent  Gary's  main  purpose  in  establishing  the  bureau 
of  educational  measurements  was  to  bring  about  a  general  im- 
provement in  the  achievements  of  pupils  throughout  the  state. 
It  was  his  belief  that  instruction  lacked  the  quality  of  thorough- 
ness which  should  be  demanded.  The  results  of  investigations 
to  date  have  fully  substantiated  this  position. 

While  attempting  to  carry  out  the  purpose  just  mentioned, 
the  bureau  does  not  limit  itself  to  efforts  at  improving  the  work 
of  classroom  teachers  and  supervisors  directly.  It  seeks  to 
improve  administrative  procedure  and  educational  conditions. 
General  school  surveys  and  surveys  of  particular  phases  of  local 
school  problems  are  undertaken.  The  Janes ville  survey  has 
been  published  as  an  example  of  a  general  survey.  Among 
other  things,  efforts  are  made  to  secure  increased  financial  support 
for  schools,  more  economical  distribution  of  school  funds,  better 
buildings  and  equipment,  higher  salaries  for  teachers,  selection  of 
better  trained  teachers,  and  improved  gradation  of  pupils. 

With  the  exception  of  the  tests  appHed  in  cities  during  the 
first  year,  standardized  educational  tests  have  been  given  chiefly 
on  a  cooperative  basis,   made  possible   through   the  generous 
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response  of  two  bodies — one  the  city  superintendents  and  the 
other  the  county  superintendents  and  supervising  teachers. 
Each  group  is  met  annually  in  conference.  At  these  conferences, 
plans  are  taken  up  for  cooperative  testing  for  the  year.  In  addi- 
tion to  the  groups  mentioned  above  certain  other  groups,  such 
as  the  teachers  in  state  normal  schools  and  those  in  the  county 
training  schools  for  teachers,  are  called  upon  at  times. 

The  schedule  carried  out  since  the  bureau  has  been  in  operation, 
the  classes  and  numbers  of  schools  reporting  complete  results,  and 
the  numbers  of  children  tested  may  be  seen  in  the  accompanying 
table. 

The  foregoing  tabulation  by  no  means  represents  all  of  the 
testing  done  during  this  time.  It  usually  happens  that  a  number 
of  schools  find  it  inadvisable  or  inconvenient  to  give  the  tests  at 
the  particular  time  set,  and  that  others  make  incomplete  or  late 
returns,  or  make  no  returns  at  all.  Many  schools  give  a  number 
of  tests  in  addition  to  the  cooperative  tests,  depending  upon  the 
nature  of  the  local  problem.  With  the  aid  of  the  bureau  a  number 
have  been  making  use  of  group  intelligence  tests.  Superintendents 
are  becoming  more  and  more  alert  to  the  necessity  of  more 
accurate  classification  and  gradation  of  pupils.  During  the  year 
1918-1919,  the  bureau  administered  its  own  group  intelligence 
tests  to  students  in  seven  of  the  state  normal  schools,  as  a  means  of 
aiding  the  normal  schools  in  studying  the  quality  of  the  prospec- 
tive teaching  material. 

In  addition  to  the  testing,  an  increasingly  large  number  of 
schools  are  engaging  in  definite  experimental  studies  of  special 
phases  of  instruction.  During  the  current  year  intensive  remedial 
work  in  reading  is  being  emphasized  more  than  any  other  topic. 

The  state  supervisors,  in  their  visits  to  schools,  are  using  the 
facts  discovered  through  the  application  of  tests.  They  meet 
teachers,  principals,  and  supervisors  individually  and  in  groups. 
At  these  meetings  they  discuss  the  test  results  and  their  applica- 
tions to  teaching  method,  course  of  study,  equipment,  and 
gradation  of  pupils.  This  personal  contact  of  the  state  super- 
visors with  the  teachers — a  contact  in  which  the  teachers  are 
helped  to  make  the  applications — is  an  essential  and  vital  part 
of  the  work  as  it  is  carried  on  from  the  Wisconsin  State  Depart- 
ment of  Public  Instruction. 


390 


JOURNAL  EDUCATIONAL  RESEARCH 


Vol.  1,  No.  5 


SUMMARY  OF  COOPERATIVE  EDUCATIONAL  TESTING  IN  WISCONSIN 

1916-19171 


Schools 

Subjects 

Test 

Scope 

No.  of 
Children 

Rural 

Spelling 
Writing 

Spelling 

Writing 

Spelling 

Arithmetic 

Reading 

Writing 

Composition 

Ayres 
Thorndike 

Ayres 

Thorndike 

Ayres 

Woody-A 

Kansas 

Thorndike 

Hillegas,  Trabue 

1173  schools 
173       '■ 

132      " 
9      " 
35  cities 
21     " 
18     " 
11     " 
15     " 

15,825 

» 

2,625 

"State  graded" 
(small  village)  — 

"State  graded" 

City 

7,465 

720 

13,111 

II 

7,500 

II 

7,549 

II 

3,866 

II 

5,848 

1917-1918 


Rural. 
II 

City.. 


Arithmetic 

Arithmetic 

Reading 

Arithmetic 
>i 

Algebra 


Stone-Original 
Woody-A 

Thorndike  Alpha  2 
Stone-Original 

"    -Equivalent 
Hotz 


27  counties 

31 

34  cities 

59    " 

33     " 

22      " 


3,395 
10,840 

9,821 
18,495 
11,010 

1,663 


1918-1919 


Rural. 
II 

City.. 


Co.  training  and 
teacher  training 
classes  in  H.  S. . . 


Spelling 

Reading 
II 

Arithmetic 

Latin 

/Reading 

\       " 
J  Arithmetic 


Buckingham 

Monroe 
II 

Theisen-Woody 

Brown 

Thorndike  A 

Rate 

Woody 

Stone 


45  counties 
43 

32  cities 
29  " 
15  " 
50  schools 
41  " 
48  " 
44      " 


9,322 

9,090 

20,254 

12,839 

1,334 

1,304 
1,214 


1919-1920 


City. 


Rural. 


Spelling 
Reading 
History 
Arithmetic 


Ashbaugh-Iowa 
Monroe  Form  H 
Van  Wagenen 
Theisen-Woody 


1  During  the  first  year,  1916-1917,  the  tests  in  cities  were  given  at  the  time  of  the 
director's  visit.  In  succeeding  years  a  definite  date  was  fixed  for  the  giving  of  the  tests 
in  all  schools. 

*  Returns  are  just  now  coming  in.  »  To  be  given  during  the  present  year. 


May,  1920  BUREAUS  OF  EDUCATIONAL  RESEARCH  391 

Some  attention  is  given  to  the  training  of  prospective  teachers 
in  the  use  and  application  of  standardized  educational  tests. 
Teachers  should  possess  at  least  a  preliminary  understanding 
and  appreciation  of  the  purposes  and  values  of  such  tests  when 
they  enter  upon  their  duties.  State  normal  schools  are  urged  to 
offer  courses  giving  specific  training  in  the  application  of  stand- 
ardized tests.  The  state  supervisors  of  educational  measurement 
assist  in  the  preparation  of  such  courses.  A  number  of  Wisconsin 
state  normal  schools  now  offer  training  in  educational  measure- 
ments either  as  a  separate  course  or  as  parts  of  other  courses  in 
education. 

The  personnel  of  the  bureau  includes,  in  addition  to  the  director, 
an  assistant  director,  Mrs.  Cecile  White  Flemming,  Supervisor  of 
Educational  Measurements,  and  a  statistical  secretary,  Miss 
Elizabeth  A.  Ahern.  Besides  the  immediate  staff  the  bureau  has, 
as  has  been  said,  the  benefit  of  the  cooperation  and  assistance  of 
other  members  of  the  staff  of  the  State  Department  of  Public 
Instruction.  Temporary  clerical  and  statistical  assistance  is 
secured  from  time  to  time  to  aid  in  busy  seasons  and  when  material 
requested  by  superintendents  is  to  be  prepared.  It  is  to  be  re- 
gretted that  sufficient  funds  are  not  provided  for  clerical  assistance 
of  a  permanent  sort.  This  need  is  sorely  felt  by  reason  of  the  fact 
that  many  schools  look  to  the  bureau  as  a  clearing  house  for 
information  on  such  matters  as  comparative  salaries,  comparative 
school  costs,  school  buildings  and  equipment,  comparative  figures 
on  standard  tests,  age-grade  statistics,  etc. 

Aside  from  its  direct  service  to  Wisconsin  schools,  the  bureau 
of  the  state  department  is  called  upon  from  time  to  time  for 
suggestions  for  the  application  of  educational  measurements 
and  the  development  of  new  bureaus  in  other  states.  No  doubt 
other  bureaus  have  had  many  similar  requests.  Such  requests 
are  an  indication  of  the  growing  demand  for  the  application 
of  scientific  methods  of  procedure  in  educational  administration 
and  supervision. 


PUTTING  STANDARDIZED  TESTS  AND  SCALES 
TO  PRACTICAL  USE  IN  THE  RURAL  SCHOOLS^ 

Samuel  S.  Brooks 
District  Superintendent,  Silver  Lake,  New  Hampshire 

A  supervisory  district  containing  26  rural,  ungraded  one-room 
schools  with  teachers  for  the  most  part  inexperienced  or  untrained, 
a  majority  of  whom  had  never  worked  under  a  superintendent  be- 
fore this,  was  the  opportunity  that  fell  to  my  lot  when  I  became  a 
New  Hampshire  superintendent  under  the  new  law  effective 
September  1,  1919.  It  was  my  first  experience  as  a  superintend- 
ent. Truly  the  district  was  "virgin  soil"  as  a  member  of  the 
state  department  remarked  to  me  when  I  took  the  position. 

Sizing  up  the  Situation 
The  first  two  or  three  weeks  were  spent  in  traveling  about  the  dis- 
trict getting  acquainted  with  the  teachers  and  sizing  up  the  situ- 
ation. Most  of  the  schools  had  already  begun,  the  teachers  having 
been  hired  by  the  local  school  boards  as  in  the  past.  I  found  that 
three  of  the  teachers  were  normal-school  graduates,  and  that  two 
had  attended  one  summer  school;  but  the  others  had  no  professional 
training  whatever.  Several  had  not  attended  school  beyond  the 
eighth  grade,  but  had  taught  from  ten  to  28  years  in  the  same 
school.  Three  were  inexperienced  high-school  graduates  in  their 
Heens.  Fifty  percent  of  all  the  teachers  had  never  seen  a  profes- 
sional book  or  magazine  and  did  not  know  where  to  obtain  one. 
All  this  of  course  had  resulted  in  an  ingrowing  provincialism  which 
could  not  but  have  a  disastrously  narrowing  effect  on  their  teach- 
ing. They  were  imitators  of  imitators.  Their  methods  were  in 
imitation  of  the  teachers  who  had  taught  them  and  who,  in  their 
turn,  had  imitated  their  own  teachers.  The  results  were  the  use  of 
methods  and  texts  so  archaic  as  to  be  amusing  if  they  had  not  been 
at  the  same  time  such  a  sad  commentary  on  our  boasted  educa- 
tional system. 

*  This  is  the  first  of  a  series  of  articles  describing  some  of  the  problems  confronting 
an  inexperienced  superintendent  of  a  rural  district  in  New  Hampshire  and  his  attempts 
to  solve  them  with  the  help  of  standardized  educational  tests  and  measurements. 
— Editor. 
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Most  of  the  textbooks  were  sadly  out  of  date.  Arithmetics, 
geographies,  grammars,  and  even  histories  published  in  the 
eighties  were  in  daily  use.  One  of  the  local  committees  insisted 
that  they  must  be  good  books  or  they  would  not  have  worn  so 
long.  Of  course  the  books  were  all  based  on  the  defunct  doctrine 
of  formal  discipline  and  showed  little  of  the  psychological  methods 
of  presenting  material  which  are  the  basis  of  modern  educational 
procedure.  The  idea  seemed  to  be  that  an  arithmetic  is  an  arith- 
metic, and  a  geography  is  a  geography  and  that  one  book  is  as 
good  as  another  so  long  as  nothing  pertaining  to  the  subject  is 
omitted  and  the  leaves  are  all  present. 

I  have  emphasized  the  teaching  and  textbook  situations  because 
I  consider  them  the  most  important  factors.  A  few  other  points 
I  shall  mention  briefly.  As  for  the  schoolhouses,  it  is  sufficient  to 
say  that  most  of  them  were  typical  New  England  rural  school 
buildings  of  ancient  vintage,  modelled  variously  (according  to  the 
idea  of  their  instigators) ,  upon  churches,  town  halls,  barns,  and  in 
some  cases  it  would  almost  seem,  upon  pigpens.  They  were 
small,  dirty,  poorly  heated,  lighted  and  ventilated,  and  in  short 
generally  unsanitary  and  ill-suited  to  their  purpose.  As  to  the 
organization  of  the  schools,  as  I  have  already  intimated,  no 
attempt  had  ever  been  made  to  grade  them.  Another  important 
factor  in  the  situation  was  the  attitude  of  the  communities  toward 
expert  supervision.  Three  of  the  four  towns  in  the  district  had 
always  opposed  such  supervision  as  long  as  it  was  optional  and 
were  not  inclined  to  submit  gracefully  when  according  to  the 
provisions  of  the  new  law  it  became  compulsory.  Such  were  the 
general  conditions  as  revealed  by  my  preliminary  survey. 

However,  there  were  three  bright  spots  in  the  general  darkness 
of  the  situation.  First,  the  splendid  new  state  school  law  which 
made  the  superintendent  a  state  official  with  a  pretty  free  hand 
and  which  provided  liberal  state  aid  for  rural  schools  where  it 
might  be  necessary  to  keep  them  up  to  the  required  minimum 
standards.  Secondly,  intelligent  school  boards  willing  to  co- 
operate. And  last,  my  own  professional  equipment  which  in- 
cluded a  pretty  thorough  training  in  educational  measurements 
and  an  earlier  experience  in  the  teaching  of  rural  schools.  Accord- 
ingly, I  tackled  the  proposition  determined  to  show  what  scien- 
tific method  in  education  could  do  for  rural  schools  if  it  had  the 
chance. 


394  JOURNAL  EDUCATIONAL  RESEARCH  Vol.  1,  No.  5 

Analyzing  the  Situation 
The  following  week  was  spent  in  analyzing  the  conditions  found 
to  exist  and  in  deciding  upon  the  most  efficient  way  to  bring  order 
out  of  chaos.  As  a  result  of  this  analysis  a  number  of  definite 
problems  seemed  to  stand  out  clearly  demanding  early  attention. 
From  among  these  problems  I  shall  select,  for  present  discussion, 
only  those,  in  the  solution  of  which  as  it  seemed  to  me,  standard- 
ized tests  and  scales  could  be  used  to  good  advantage. 

Problem  1. — To  grade  the  schools  fairly  and  accurately. — Getting 
the  schools  graded  in  order  to  start  the  pupils  right  for  their 
year's  work  was  of  course  the  most  urgent  problem.  It  would 
have  been  a  comparatively  simple  matter  to  grade  them  arbitrar- 
ily on  the  basis  of  the  teachers'  judgments.  But  there  are  serious 
objections  to  this  method  even  as  a  beginning,  especially  when  the 
teacher  is  new  to  the  school.  If,  for  example,  children  are  placed 
in  grades  lower  than  their  parents  think  they  ought  to  be,  there  is 
bound  to  be  some  strenuous  objections  from  some  of  these  parents 
and  the  only  evidence  one  has  to  offer  is  that  the  teacher  thought 
the  children  ought  to  be  placed  in  those  grades.  Did  you  never 
hear  this  line  of  talk  from  an  irate  parent?  "My  John  is  just  as 
smart  as  Mrs.  Smith's  Henry  and  he  ought  to  be  in  the  same  class 
or  above.  It's  a  plain  case  of  showing  partiality  so  there  now! 
if  just  won't  stand  it!" 

It  is  not  by  any  means  easy  in  such  cases  to  prove  to  the 
satisfaction  of  the  parent  that  the  teacher  has  a  sound  basis  for 
her  judgment.  And  the  fact  is  that  she  did  not  have  a  sound 
basis.  How  did  she  know  just  what  knowledge  or  ability  a  child 
should  exhibit  in  order  to  belong  in  a  certain  grade?  What  stand- 
ards of  achievement  did  she  have  for  the  different  grades  besides 
her  own  arbitrary  judgment? 

Giving  ordinary  tests  for  grading  purposes  is  also  inaccurate  and 
unfair,  because  such  tests  are  devised  by  the  teacher  or  superin- 
tendent and  hence  represent  merely  their  judgment  as  to  what 
they  think  a  child  ought  to  know  in  order  to  be  placed  in  a  certain 
grade. 

Worse  than  all  else,  the  children  themselves  are  apt  to  become 
discouraged,  not  understanding  wherein  they  have  failed,  and 
being  at  a  loss  as  to  just  what  they  are  expected  to  achieve.  Even 
the  superintendent  and  teachers,  if  they  are  conscientious,  are 
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not  satisfied  because  they  cannot  feel  sure  that  injustice  has  not 
been  done.  Retarding  a  child  without  good  reason,  thus  robbing 
him  of  a  year  of  his  time,  is  a  serious  matter,  at  least  for  the  child. 

What  method  of  grading  then  could  be  found  which  would 
be  fair  to  all  concerned?  After  casting  about  for  some  time 
for  a  solution  to  this  problem,  it  suddenly  occurred  to  me  that 
standardized  tests  would  help  me  out  of  my  difficulty.  Did 
they  not  offer  definite  standards  of  achievement  for  each  grade? 
And  those  standards  were  not  based  on  unattainable  100  percent 
perfection  nor  upon  the  opinions  of  dogmatic  educators  as  to  what 
a  child  ought  to  know  at  the  end  of  a  certain  grade.  They  were 
experimentally  derived  and  based  upon  the  amount  of  work  that 
normal  children  are  actually  doing  in  the  different  grades  through- 
out the  whole  country  and  not  upon  the  amount  of  work  somebody 
thinks  they  ought  to  do. 

By  giving  these  tests  in  all  my  schools  I  could  determine  just 
where  each  child  belonged  on  the  educational  ladder.  The  proc- 
ess would  be  roughly  comparable  to  measuring  a  large  number  of 
sticks  of  various  lengths  by  means  of  a  tape  measure  sorting  them 
into  eight  piles,  each  pile  containing  sticks  of  about  the  same 
length.  Then  when  angry  parents  wanted  to  know  why  their 
children  were  graded  so  low,  I  could  show  them.  The  children 
themselves  could  be  made  to  see  wherein  they  had  fallen  below 
standard  and  what  they  would  have  to  do  to  come  up  to  the 
standard.  Both  superintendent  and  teachers  would  feel  that 
they  were  on  solid  ground.  Surely  I  needed  standardized  tests 
the  first  thing. 

Having  reached  this  conclusion,  I  immediately  ordered  all  the 
tests  and  scales  I  knew  of  that  were  sufficiently  well  standardized 
for  my  purpose.  They  covered  the  following  subjects:  arith- 
metic, silent  and  oral  reading,  spelling,  writing,  geography,  history 
and  English  language.^ 

Problem  2. — How  to  measure  the  progress  of  pupils. — Having 
settled  upon  how  to  do  the  preliminary  grading,  the  next  problem 

'For  those  who  do  not  know  standardized  tests  and  want  to  get  acquainted  I 
recommend  for  a  beginning  the  purchase  of  Measuring  the  Results  of  Teaching  by 
Monroe,  and  Educational  Tests  and  Measurements  by  Monroe,  DeVoss,  and  Kelly. 
Both  books  describe  the  best  tests  and  their  uses  and  the  former  tells  where  to  obtain 
them.  These  books  are  published  by  Houghton  Miflflin  Company,  Boston  and  else- 
where. 
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was  to  find  a  just  method  of  measuring  the  progress  of  pupils  for 
promotion  purposes.  The  same  objections  to  teachers'  tests  hold 
good  here  as  were  noted  in  discussing  the  previous  problem. 

This  problem  involved,  obviously,  the  finding  of  a  satisfactory 
system  of  marking.  It  has  been  proved  beyond  doubt  that 
ordinary  teachers'  marks  are  unfair,  inaccurate,  and  generally 
unsatisfactory  as  a  means  of  measuring  progress  or  as  a  basis  for 
promotion. 

In  measuring  the  progress  of  pupils,  standardized  tests  must 
surely  find  their  widest  field  of  usefulness.  Here  the  process  can 
be  compared  to  standing  a  ten-foot  measuring  rod  beside  a  young 
tree  when  it  is  a  foot  high  and  noting  its  growth  in  height.  When 
it  has  added  another  twelve  inches  it  belongs  in  the  two-foot  class. 
Twelve  inches  more  and  it  is  promoted  to  the  three-foot  class,  and 
so  on.  It  is  even  possible  to  devise  a  satisfactory  system  of  mark- 
ing, for  report  card  purposes,  with  the  aid  of  such  tests,  as  will  be 
explained  later  on. 

Some  of  the  teachers  thought  that  the  new  state  program  of 
studies  for  elementary  schools  would  be  sufficient  guide  for  pro- 
motion purposes.  This  program  is  thoroughly  practical  and  up- 
to-date.  But  it  offers  no  definite,  objective  standards  of  achieve- 
ment from  grade  to  grade.  Therefore  it  is  not  a  satisfactory  tool 
with  which  to  measure  the  progress  of  pupils  and  to  determine 
when  they  are  ready  for  promotion.  It  is  true  that  a  printed 
program  of  studies  specifies  the  subject-matter  to  be  covered  by 
each  grade  but  it  is  left  entirely  to  the  judgment  of  the  teacher 
as  to  when  that  subject-matter  is  covered  satisfactorily.  The 
ground  may  be  gone  over  more  or  less  thoroughly  and  with  very 
unequal  results  according  to  the  methods  and  arbitrary  standards 
of  the  individual  teacher.  Hence,  it  is  obvious  that  programs  of 
study  cannot  take  the  place  of  standardized  tests  that  are  even 
fairly   objective. 

Problem  3. — How  to  measure  the  ability  of  teachers. — One  of  the 
greatest  needs  of  superintendents  is  a  method  of  measuring  the 
ability  of  teachers  that  will  be  accurate  and  fair  to  all  concerned. 
A  method  that  will  not  leave  the  superintendent  open  to  the 
charge  of  favoritism  or  poor  judgment.  A  method  that  will 
satisfy  a  teacher  who  has  been  rated  something  less  than 
"excellent"  that  her  shortcomings  are  real  and  not  hallucinations 
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in  the  mind  of  the  superintendent  due  to  his  personal  dislikes  and 
prejudices. 

What  is  wanted  is  concrete  evidence  of  a  teacher's  ability  or 
lack  of  ability  that  will  allay  carping  criticism  from  whatever 
source.  It  is  decidedly  neither  accurate  nor  fair  to  estimate  a 
teacher's  ability  solely  by  observation  made  by  the  superintend- 
ent during  his  visits  to  the  classroom.  It  is  not  fair  because  (a) 
such  observations  do  not  furnish  a  sound  basis  for  judgment,  (b) 
the  superintendent's  opinions  are  quite  apt  to  be  colored  by 
personal  prejudices  toward  an  individual  teacher  or  her  methods, 
(c)  classes  often  show  at  their  worst  in  the  presence  of  visitors,  (d) 
even  the  teacher  may  fail  to  do  herself  justice  under  the  critical 
eye  of  the  superintendent.  It  is  inaccurate  for  all  the  reasons 
noted  above  and  because  (a)  some  teachers  do  excellent  work  when 
the  superintendent  is  present  and  shirk  all  the  rest  of  the  time, 
and  (b)  if  such  teachers  do  their  own  testing,  even  the  results  may 
be  made  falsely  to  appear  satisfactory. 

Provided  a  teacher  is  of  good  moral  character  with  high  ideals 
and  a  fairly  pleasant  personality,  her  further  desirability  as  a 
teacher  is  measured  by  the  results  she  gets  as  determined  by  the 
progress  of  the  pupils  when  such  progress  is  objectively  measured. 
After  all,  it  is  results  we  are  after,  primarily.  Hence,  the  stand- 
ardized tests  measure  objectively  both  the  progress  of  the  pupils 
and  the  ability  of  the  teacher  at  one  and  the  same  time. 

Problem  4. — To  find  a  practical  method  of  supervising  study  and 
of  teaching  how  to  study. — This  may  seem  like  a  large  contract  for 
the  one-teacher  rural  school  with  its  crowded  curriculum,  but  I 
shall  try  to  show  that  it  can  be  successfully  worked  out  by  using 
proper  methods  of  study  supplemented  by  judicious  use  of  the 
standardized  educational  tests  and  measurements. 

This  paper  merely  presents  some  of  the  problems  confronting 
me  in  my  new  work  together  with  some  plans  for  their  solution  and 
reasons  therefor.  Following  articles  will  describe  in  detail  the 
working  out  of  these  plans  and  the  results  achieved. 


COEFFICIENTS  OF  REGRESSION 

Leonard  P.  Ayres 
Russell  Sage  Foundation 

In  the  March  and  April  numbers  of  the  Journal  of  Educational 
Research  there  were  published  articles  by  the  writer  on  shorter 
methods  for  computing  the  coefficient  of  correlation.  The  object 
of  the  present  article  is  to  describe  a  short  method  for  computing 
the  coefficients  of  regression  and  to  comment  briefly  on  the  prac- 
tical utility  of  that  measure  of  relationship. 

The  coefficient  of  regression  is  a  measure  which  tells  how  much 
change  takes  place  in  one  of  two  series  of  paired  values  for  each 
change  of  one  unit  in  the  other  series.  Suppose  we  have  a  set  of 
figures  giving  the  ages  and  grades  of  the  children  in  a  school 
system.  Since  the  plan  of  the  system  is  that  children  shall  be 
promoted  one  grade  each  year,  it  is  sure  that  there  will  be  a  high 
correlation  between  the  two  series. 

We  know,  however,  that  in  nearly  all  school  systems  many 
children  fail  to  go  forward  at  the  rate  of  a  grade  each  year  and  that 
the  average  progress  is  in  marked  degree  less  than  the  ideal.  The 
coefficient  of  regression  is  the  measure  which  will  tell  us  what  the 
average  rate  of  progress  is.  It  will  tell  what  the  change  is  in 
grades  for  each  change  in  years  or  what  part  of  a  grade  the  average 
child  tends  to  advance  for  each  additional  year  of  age.  This  is 
what  is  meant  in  this  particular  case  by  the  statement  that  the 
coefficient  of  regression  shows  the  change  in  one  series  for  a  unit 
of  change  in  the  other. 

The  formula  for  the  coefficient  of  regression,  as  it  has  ordinarily 
been  stated,  is  not  easy  to  use  or  understand,  but  its  difficulties 
are  mostly  easy  to  avoid.  Its  use  will  be  illustrated  by  finding 
it  for  two  correlations,  one  for  a  short  list  of  paired  values  and  the 
other  for  a  table  of  distribution.  The  formula  for  finding  the 
coefficient  of  correlation  is  the  one  explained  by  the  writer  in  the 
two  previous  articles  published  in  this  magazine.    It  is  as  follows: 
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Sum  of  products  of  subject  and  relative  items 

minus 
av.  of  subject  items  X  tot.  of  relative  items 

Sum  of  squares  of  sub.  items  Sum  of  squares  of  rel.  items 

minus  yC  minus 

av.    X    total  of  these  items  av.   X  total  of  these  items 

Let  US  apply  this  formula  to  a  short  list  of  paired  values  repre- 
senting the  ages  and  grades  of  ten  school  children.  Two  of  them 
began  school  four  years  ago,  two  three  years  ago,  two  two  years 
ago,  two  last  year,  and  two  this  year.  They  all  entered  at  the  age 
of  six.  One  of  each  pair  went  forward  one  grade  each  year  while 
the  other  spent  two  years  in  each  grade.  Their  ages  and  grades, 
together  with  the  computation  of  the  coefficient  of  correlation, 
are  shown  in  the  following  tabulation : 


Grades 

Ages 

(Sub.) 

(Rel.) 

Sub.« 

Rel.» 

S  XR 

1 

6 

1 

36 

6 

1 

6 

1 

36 

6 

1 

7 

1 

49 

7 

2 

7 

4 

49 

14 

2 

8 

4 

64 

16 

2 

9 

4 

81 

18 

3 

8 

9 

64 

24 

3 

10 

9 

100 

30 

4 

9 

16 

81 

36 

5 

10 

25 

100 

50 

Total      24 

80 

74 

660 

207 

Average    2.4 

8 

80  X  2.4 

=  192 

24  X  2.4 

=  57.6 

80  X  8.0  = 

=  640 

207 

-192  = 

IS 

74 

-57.6  = 

=  17.4 

660 

-640  = 

20 

15  15         15 

=0.80 


^\1A  X  20     v^348    18.65 

In  this  example  the  coefficient  of  correlation  is  equal   to  the 

fraction  — .    The  numerator  (15)  is  derived  from  the 

^17.4X20 
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products  of  the  items  of  the  two  series.  The  denominator  is  equal 
to  the  square  root  of  the  product  of  two  numbers,  which  are  17.4 
and  20.  The  first  of  these  two  numbers  is  derived  from  the  sub- 
ject series,  giving  the  data  for  grades,  and  the  second  from  the 
relative  series,  giving  the  data  for  ages. 
The  coeflScients  of  regression  are  derived  from  this  fraction  and 

are-— —  and  —     The  first  has  as  its  denominator  the  number 
17.4         20 


17.4,  which  was  derived  from  the  data  as  to  grades.  The  co- 
efficient of  regression     tells  the  amount  of  change  in  ages 

taking  place  on  the  average  in  this  group  for  a  change  of  one  in  the 
grades.  This  information  does  not  in  this  particular  case  give  us 
information  of  much  value. 

The  other  coefficient  of  regression  is  the  fraction         —  in 

20 

which  the  denominator  was  derived  from  the  data  on  ages.    This 

coefficient  tells  us  how  much  the  children  in  this  group  go  forward 

in  the  grades  on  the  average  for  each  advancing  year  of  age.    It 

15  3 

tells  us  that  they  go  forward  —  or  —  of  a  grade  for  each  year 

of  age.  This  is  in  accord  with  the  original  conditions  of  the  prob- 
lem, for  it  was  stated  that  half  the  children  made  100  percent  of 
normal  progress  and  the  other  half  50  percent,  or  an  average  of 
75  percent  of  the  full  rate. 

This  is  information  of  an  important  type  that  cannot  be  secured 
by  the  simpler  processes  of  working  directly  with  the  averages  of 
the  series  and  trying  to  compute  the  relationship  between  the 
time  the  children  have  been  in  school  and  the  progress  they  have 
made.  In  many  sorts  of  results  from  tests  of  classroom  work  the 
coefficients  of  regression  can  be  used  to  great  advantage. 

The  method  described  for  finding  these  coefficients  is  far  simpler 
than  the  one  usually  used.  The  formula  commonly  given  (rho 
standing  for  the  coefficient  of  regression)  is  p  =  r— • 

era 

The  steps  by  which  the  method  here  described  was  derived  from 
the  standard  formula  may  be  readily  followed  through  by  anyone 
familiar  with  the  ordinary  notations  for  the  coefficient  of  correla- 
tion.   They  are  as  follows: 
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p' 

1  X  y 
H  ffi  at 

x^ 

1  xy 

or 


"V^^V-f  v^^ 


p= 


Sy» 


The  application  of  the  method  described  may  be  again  illus- 
trated by  using  as  an  example  an  age  and  grade  table.  The  one 
chosen  is  a  supposititious  distribution  for  a  system  where  160 
children  enter  each  year  at  the  age  of  six.  They  are  promoted 
annually  at  a  75  percent  rate  and  none  drop  out.  The  data  for 
the  table,  together  with  the  computations  of  the  coeflScients 
of  correlation  and  regression,  are  shown  in  the  accompanying 
tabulation. 


s 

R 

— Ages 

T 

Grades 

6 

7 

8 

9 

10 

11 

12 

13 

ST        SST 

1 

160 

40 

10 

2 

212 

212          212 

2 

120 

60 

23 

8 

2 

213 

426          852 

3 

90 

67 

34 

15 

6 

2 

214 

642        1,926 

4 

68 

67 

42 

22 

9 

208 

832        3,328 

5 

51 

63 

47 

29 

190 

950       4,750 

6 

38 

56 

49 

143 

858       5,148 

7 

29 

49 

78 

546       3,822 

8 

22 

22 

176        1,408 

T 

160 

160 

160 

160 

160 

160 

160 

160 

1,280 

4,642      21,446 

av.  of  sub.  items 

RT 

960 

1,120 

1,280 

1,440 

1,600 

1,760 

1,920 

2,080 

12,160 

1,280 

RRT 

5,760 

7,840 

10,240 

12,960 

16,000 

19,360 

23,040 

27,040 

122,240 

2Sf 

160 

280 

400 

521 

641 

760 

880 

1,000 

av.  of  rel.  items 

R(2Sf) 

960 

1,960 

3,200 

4,689 

6,410 

8,360 

10,560 

13,000 

49,139 

1,280 
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4,642X9.5=44,099 
4,642X3.627  =  16,836 
12,160X9.5  =  115,520 

49,139-  44,099  =  5,040 

21,446-   16,836=4,610 

122,240-115,520  =  6,720 

5,040  5,040        5,040 

■0.91 


^^4,610  X  6,720     >^30,979,200    5,566 
p,«1.09        ps  =  0.75 

In  this  case  the  coefficient  of  correlation  is  0.91.  Such  co- 
efficients based  on  age  and  grade  tables  are  always  high  and  there 
is  surprisingly  small  range  between  those  for  relatively  efficient 
school  systems,  having  little  retardation  and  those  for  far  less 
effective  systems  showing  high  percentages  of  retardation. 

The  coefficients  of  regression  are  of  greater  interest  and  more 
value.  In  this  case  the  coefficient  of  regression  based  on  the  grades 
is  1 .  09.  This  indicates  that  in  this  school  system  the  children 
tend  to  average  1 .  09  increase  in  years  of  age  for  each  advance  of 
one  grade. 

The  other  coefficient  in  this  case  gives  us  more  valuable  infor- 
mation. It  is  0. 75  and  is  based  on  the  ages.  It  tells  us  that  the 
children  in  this  system  tend  to  go  forward  on  the  average  three- 
fourths  of  a  grade  for  each  advance  of  one  year  in  age.  This  is  in 
agreement  with  the  conditions  laid  down  at  the  outset  which  were 
that  these  children  were  regularly  promoted  at  a  75  percent  rate. 

Coefficients  of  regression  can  be  made  to  yield  information  of 
great  practical  value.  They  may  well  be  used  in  studying  such 
questions  as:  regularity  of  attendance  and  promotion  rates,  defi- 
ciency in  weight  and  hemoglobin  counts,  progress  through  the 
grades  and  expenditures  for  supervision,  pages  of  material  read 
in  the  first  three  grades  and  ability  in  silent  reading,  time  spent 
on  spelling  drills  and  scores  in  spelling  ability,  years  of  schooling 
and  earnings  up  to  the  age  of  fifty,  and  many  others  of  the  most 
varied  character. 


REVISING  THE  COURSE  OF  STUDY 

In  the  voluminous  discussion  of  the  reconstruction  of  the  cur- 
riculum during  the  past  year  nothing  is  said  about  the  cost.  It  is 
assumed  that  if  the  superintendent  and  teachers  decide  upon  a 
revision,  the  staff  will  perform  the  task  in  their  leisure  time.  But 
such  an  assumption  is  entirely  erroneous.  A  new  course  of  study 
can  be  prepared  by  the  staff  but  a  thorough-going  revision  involves 
too  much  detail  work  of  a  clerical,  time-consuming  sort  for  a  ay 
staff  to  be  able  to  perform  it  in  their  free  time.  To  discover  the 
common  errors  in  language  in  a  school  system  as  a  basis  for  a 
language  curriculum  requires  anywhere  from  two  hundred  to  five 
hundred  hours  of  clerical  work,  which  is  the  full  time  of  one  person 
for  at  least  a  month  of  eight-hour  days;  and  this  does  not  include 
the  time  of  the  supervisor  of  the  study  who  formulates  the  plans 
and  writes  the  report.  To  discover  what  mathematics  is  needed 
as  a  preparation  for  the  study  of  one  textbook  in  chemistry  involves 
fifty  hours  of  clerical  work  in  addition  to  forty  hours  devoted  to  the 
study  by  the  supervisor.  To  collect  practical  problems  and  proj- 
ects to  supplement  the  teaching  of  physiology  and  hygiene, 
arrange  the  necessary  material,  and  prepare  it  for  classroom  use 
involves  the  expenditure  of  fifty  hours  each  for  three  persons.  And 
all  of  these  are  fragmentary  studies. 

It  is  quite  as  reasonable  to  expect  the  manual  arts  department 
to  build  the  school  buildings  without  assistance  as  to  expect  the 
staff  to  revise  the  course  of  study  in  their  free  time.  Bricks  can- 
not be  handled  as  rapidly  as  ideas  but  there  are  more  ideas  in  the 
course  of  study  than  bricks  in  a  building  and  it  takes  time  to  han- 
dle ideas.  The  task  of  the  revision  of  what  children  are  taught  is 
immeasurably  more  important  than  the  construction  of  buildings 
and  the  difficulties  are  much  more  complex  and  quite  as  time- 
consuming  if  the  work  is  thoroughly  done. 

It  is,  therefore,  necessary  for  boards  of  education  who  authorize 
a  revision  of  the  course  of  study  to  provide  funds  to  make  it 
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possible  for  certain  teachers  to  be  relieved  of  part  of  their  duties, 
to  engage  clerical  assistance,  to  employ  experts  on  technical 
phases  of  the  problem,  and  to  make  the  necessary  studies  in  the 
research  department.  It  is  becoming  increasingly  necessary  for 
state  departments,  the  federal  bureau  of  education,  and  other 
large  educational  units  to  establish  the  curriculum  as  one  of  the 
major  projects  of  investigation  with  a  staff  sufficiently  large  to 
make  revision  more  than  a  makeshift.  The  deadweight  of  the 
load  is  much  greater  than  administrators  have  generally  realized. 
The  work  cannot  be  done  by  discussion  and  argument.  Detailed 
studies  are  necessary  and  details  cost  money. 

w.  w.  c. 

SCIENTIFIC  CURRICULUM  BUILDING 

Scientific  curriculum  building  involves  a  danger  of  which  the 
curriculum  makers  do  not  appear  to  be  aware.  The  method  as 
frequently  practised  consists  in  finding  out  what  elements  of 
school  subjects  are  in  frequent  use  and  incorporating  these 
elements  into  the  subject  matter  to  be  taught.  Analysis  reveals,  for 
example,  that  adults  make  almost  no  use  of  fractions  or  decimals; 
that  periodicals  and  newspapers  contain  surprisingly  few  histori- 
cal or  geographic  allusions;  and  that  the  fundamental  vocabulary 
of  business  and  personal  correspondence  is  astonishingly  small. 

Sometimes  the  analyst  reaches  the  conclusion,  expressed  or 
tacit,  that  the  curriculum  should  contain  no  more  than  these  mea- 
ger elements  which  he  has  found  to  be  in  frequent  use.  More 
often,  however,  it  is  those  who  use  his  results  who  reach  this 
conclusion.  This,  we  maintain,  is  not  a  correct  inference.  The 
only  correct  inference — and  it  is  the  inference  of  the  more  careful 
workers — is  that,  no  matter  what  else  is  included,  the  elements 
thus  found  to  be  socially  useful  shall  certainly  form  part  of  the 
curriculum;  in  other  words,  that  they  shall  constitute  a  part  of  the 
"minimum  essentials"  of  the  subject  to  which  they  belong. 

The  bearing  of  analyses  of  social  needs  upon  the  curriculum  may 
be  most  completely  illustrated  with  reference  to  spelling.  This 
is  true  not  only  because  the  social  value  of  spelling  is  obvious  but 
also  because  more  analyses  have  been  made  of  spelling  usage  than 
of  any  other.  The  principles,  however,  which  we  shall  suggest 
have  a  general  application  to  all  the  subjects  which  have  been 
similarly  studied. 
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In  the  first  place,  we  cannot  by  any  means  be  sure  that  the 
present  determination  of  frequency  of  use  is  the  true  one.  For 
example,  in  the  list  which  purports  to  consist  of  the  thousand 
commonest  words,  we  do  not  find  the  names  of  our  daily  meals — 
neither  breakfast  nor  lunch,  dinner  nor  supper.  Nor  do  we  find 
the  commonest  articles  of  tableware,  such  as  plate,  cup,  knife, 
fork,  and  spoon.  Many  articles  of  food — potatoes,  beans,  beets, 
peas,  meat,  fish,  bread,  and  butter — are  not  named ;  nor  are  some  of 
the  commonest  articles  of  clothing  nor  some  of  the  most  familiar 
colors.  Only  the  horse  is  mentioned  among  domestic  animals. 
The  dog  and  the  cat,  the  cow  and  the  sheep  find  no  place  in  the 
list. 

One  may  contend  that  these  may  indeed  be  common  words 
without  being  frequently  used  in  written  discourse.  The  conten- 
tion, however,  has  little  plausibility.  A  child  cannot  write  of  his 
play  without  using  such  words  as  hide,  jump,  swim,  fish,  or  sled, 
and  these  words  are  omitted  from  the  thousand  most  frequently 
used.  He  can  scarcely  write  of  the  barnyard  without  requiring 
such  omitted  words  as  hen  and  egg;  he  cannot  write  about  his 
garden  nor  the  baby  at  home;  nor  about  the  moon,  the  sun,  the  sky 
nor  the  stars.  Yet  these  are  the  things  within  his  experience. 
They  are,  therefore,  the  sort  of  topics  which  we  should  expect  him 
to  write  about. 

On  the  other  hand,  among  the  "thousand  commonest  words" 
are  found  these:  preliminary,  recommend,  impossible,  assure,  com- 
mittee, investigate,  national;  and  a  number  of  terms  of  apparently 
legal  meaning  such  as  property,  judgment,  testimony,  complaint, 
agreement,  witness,  and  conviction.  This  suggests  that  the  source 
of  our  vocabulary  studies  must  be  very  greatly  widened  and  that 
an  enormously  greater  amount  of  written  material  must  be 
examined. 

In  the  second  place,  even  if  true  frequency  of  use  has  been 
determined,  we  assert  that  there  are  other  tests  of  value  than 
frequency  of  use.  For  example,  although  the  word  bread  may  be 
rightly  excluded  from  the  thousand  commonest  words;  yet  cir- 
cumstances which,  while  they  may  be  relatively  infrequent  are 
nevertheless  inevitable,  will  certainly  make  it  at  times  indispen- 
sable in  one's  written  vocabulary.  Future  research  may  con- 
ceivably confirm  the  present  determination  that  apple  and  banana, 
bright  and  beautiful,  meat  and  drink,  likewise  do  not  belong  to  the 
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thousand  commonest  words.  But  this  is  not  a  sufficient  reason  why 
they  should  be  banished  from  our  spelling  curriculum.  These 
are  simple  words  and  they  stand  for  ideas  common  to  the  race. 
The  ideas  may  not  require  expression  quite  often  enough  to  secure 
for  the  words  a  place  among  those  used  with  an  assigned  frequency; 
but  when  these  ideas  do  require  expression — and  no  one  can  escape 
the  necessity  for  such  expression — they  become  as  "socially 
useful"  as  do  their  more  frequently  used  competitors. 

In  the  third  place,  in  selecting  material  for  the  school  curricu- 
lum, difficulty  as  well  as  frequency  of  use  is  a  criterion.  Indeed 
to  a  certain  extent  there  is  an  inverse  relationship  between  diffi- 
culty and  frequency  of  use.  Some  elements  of  school  subjects, 
precisely  because  they  are  frequently  used,  and  hence  often  re- 
peated, do  not  need  to  be  taught  at  all.  Such  is  the  case,  for 
example,  with  most  of  the  two  and  three  letter  words  in  our 
language.  No  one  who  is  in  the  least  degree  literate  misspells  and 
except  by  inadvertency — and  correcting  inadvertency  is  not  a 
spelling  problem.  Some  of  the  recent  spellers  in  their  attempts  to 
adhere  to  the  vocabulary  studies  have  included  a  considerable 
group  of  words  which  do  not  constitute  a  spelling  problem. 

In  the  fourth  place,  whether  with  reference  to  spelling  or  any 
other  subject  of  the  curriculum,  whatever  the  much-discussed 
aim  of  education  may  be  it  contemplates  something  more  than  the 
round  of  common  experiences,  something  richer  than  the  elemen- 
tal facts  of  life.  "A  man's  reach  should  exceed  his  grasp" ;  and  it 
is  only  by  providing  for  more  than  is  now  generally  available  that 
progress  is  possible.  Here  as  elsewhere  in  the  application  of 
scientific  procedure  to  education,  a  sound  philosophy — as  well  as 
a  sound  common  sense — must  be  invoked  to  save  the  scientific 
procedure  from  itself. 

Four  points  may,  therefore,  be  made  with  reference  to  the  suffi- 
ciency of  the  idea  of  frequency  of  use.  The  first  is  that  material 
far  greater  in  amount  and  variety  will  have  to  be  examined  before 
we  can  be  sure  that  frequency  of  use  has  been  determined.  The 
second  is  that  certain  material  of  relatively  low  frequency  of 
occurrence  has  a  social  usefulness  which  renders  it  indispensable. 
The  third  is  that  difficulty,  or  need  of  being  taught,  is  an  important 
criterion — one  which  operates  in  particular  to  reject  from  the 
formal  curriculum  an  appreciable  amount  of  frequently  used 
material.     The  fourth  is  that  if  we  include  in  our  curriculum  only 
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the  materials  which  are  found  to  be  frequently  used  by  children 
and  adults  we  leave  altogether  out  of  account  the  material  which 
they  ought  to  use  and  would  use  if  their  lives  were  fuller  and 
richer.  This  fullness  and  richness,  we  feel  quite  sure,  the  school 
must  envisage.  Moreover,  to  adjust  the  curriculum  merely  to 
current  usage  is  to  doom  our  educational  system  to  a  static  con- 
dition wherein  progress  becomes  impossible. 

B.  R.  B. 


Virginia  Education  Commission.    Virginia  public  schools.    (Including  the  report 

of  the  Survey  Staff.)  Richmond,  Va.:  Everett  Waddey  Co.,  1919.  400  pp. 
Very  businesslike  is  this  report.  Its  precision  of  aim  gives  it  a  certain^directness 
and  point  which  is  often  lacking  in  surveys  whose  object  is  merely  to  find  out  some- 
thing. Moreover,  the  survey  is  peculiar  in  other  respects.  In  the  first  place,  it  is  a 
state  survey  and,  while  the  system  is  not  among  the  largest,  it  is  by  no  means  small. 
In  the  second  place,  considering  the  bigness  of  the  undertaking  and  the  wide  range  of 
topics  discussed,  the  survey  report  is  brief — brief  in  a  day  when  brevity  of  reporting 
is  by  no  means  common.  In  the  third  place,  being  a  state  report,  its  findings  work 
over  inevitably  into  recommended  legislation,  i.e.,  into  provisions  for  specific  improve- 
ments. In  the  fourth  place,  there  is  an  entire  absence  of  either  animus  or  the  effort 
to  "get"  somebody. 

Despite  the  brevity  of  the  report,  an  abstract  of  it  would  be  too  extensive.  More- 
over, the  book,  we  are  told,  will  be  published  shortly  by  a  commercial  house  and  will, 
therefore,  be  easily  available.  We  feel  inclined  strongly  to  recommend  it  to  students, 
nor  should  we  be  greatly  surprised  if  professors  of  education  should  find  parts  of  it — 
especially  the  financial  parts — useful  as  required  reading.  pr»|g  f^**-*  m-- 

As  an  example  of  a  good  method  in  reporting,  it  seems  to  us  that  the  book  is 
distinctive.  The  main  body  of  tabular  material  is  thrown  into  the  back  of  the  volume; 
this  device  adds  to  the  readability  of  the  report.  We  beg,  however,  to  suggest  an 
added  improvement,  namely,  that  the  reading  matter  should  be  complete  in  itself;  in 
other  words,  that  the  reader  should  be  conscious  of  no  loss  of  essential  detail.  Thus, 
the  text  should  not  directly  require  the  reader  to  consult  the  tables.  It  should  form  a 
consecutive  whole,  and  the  references  to  tables,  like  bibliographical  citations,  should 
be  carried  in  footnotes. 

The  legal  status  of  schools  in  Virginia  is  peculiar  in  that  the  constitution,  instead 
of  confining  itself  to  general  provisions,  embodies  many  details.  Accordingly,  many 
of  the  survey  recommendations  require  constitutional  amendments.  Some  of  these 
amendments  were  proposed  by  the  1918  assembly;  others  will  have  to  come  up  for  the 
first  time  this  year.  They  must  then  be  passed  again  in  1922  and  submitted  to  the 
people. 
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Some  of  the  important  recommendations  of  the  commission  to  the  General  Assem- 
bly— recommendations  in  almost  complete  agreement  with  the  corresponding  recom- 
mendations of  the  survey  staff  to  the  commission — are  as  follows:  (1)  that  the  state 
board  of  education  be  appointed  by  the  governor,  and  that  it  select  the  state  superin- 
tendent at  large;  (2)  that  division  superintendents  be  elected  by  local  school  boards 
from  a  list  of  eligibles  prepared  by  the  state  board  of  education;  (3)  that  the  district 
unit  be  abolished  in  favor  of  the  county  (city  or  town)  unit;  (4)  that  the  state  school 
fund  be  distributed  as  follows:  an  amount  not  to  exceed  5  percent  to  be  used  as  a 
special  relief  fund;  of  the  remainder,  one-third  to  be  distributed  on  average  or  aggregate 
attendance,  one-third  on  the  number  of  teachers  employed,  and  one-third  according  to 
the  adequacy  of  the  local  support;  (5)  that  an  effective  compulsory  education  law  and 
a  school  term  of  nine  months  be  provided;  (6)  that  assessments  be  increased  and  equal- 
ized and  the  constitutional  tax  limit  removed,  the  limit  to  be  determined  by  the  legis- 
lature; (7)  that  free  textbooks  be  provided  at  state  expense;  (8)  that  teachers'  salaries 
be  increased  and  based  on  minimum  professional  qualifications,  the  state  tax  being 
increased  from  fourteen  to  twenty  cents  to  provide  a  part  of  the  necessary  funds; 
(9)  that,  as  to  teacher-training,  normal  schools  abolish  high-school  courses,  train  only 
elementary  school  teachers,  and  extend  the  professional  course  from  two  to  three  years; 
that  training  departments  in  high  schools  be  abandoned;  that  state  institutions  of  higher 
learning  be  operated  all  the  year  round  on  the  four-quarter  basis,  with  special  provision 
by  means  of  two  six-week  terms  in  the  summer  for  public  school  teachers;  (10)  that 
vocational  education,  physical  training  and  school  hygiene,  education  of  negroes,  and 
thee  onsolidation  and  improvement  of  rural  schools  be  definitely  organized. 

The  survey  has  not  failed  to  provide  for  adequate  financial  support  for  the  public 
school  system  as  it  would  be  constituted  if  these  recommendations  were  enacted  into 
law.  We  should  not  know  where  to  turn  to  find  a.  clearer  statement  of  how  to  deter- 
mine and  provide  the  amount  of  money  needed  to  operate  a  good  school  system. 

The  General  Assembly  of  1918  had  appropriated  $10,000  for  the  survey  commis- 
sion. Later  it  seemed  advisable  to  create  a  division  of  tests  and  measurements.  It 
was  evident,  however,  that,  in  order  to  do  anything  at  all  adequate  in  applying  educa- 
tional and  psychological  tests  throughout  the  state,  a  great  deal  more  money  would 
be  needed  than  the  survey  had  in  hand.  Fortunately,  the  General  Education  Board 
was  induced  to  appropriate  $12,500  for  this  purpose. 

Accordingly,  for  the  first  time  in  a  state  survey  an  attempt  was  made  to  ascertain 
the  character  of  the  work  of  the  schools  by  means  of  actual  standardized  tests. 

The  chapter  devoted  to  the  work  of  this  division  is  entitled:  "The  Results  of 
Instruction  Measured."  It  is  wholly  inadequate;  and  the  propriety  of  including  it  in 
the  survey  volume  is  doubtful,  especially  since  a  special  report  on  this  phase  of  the 
survey  work  is  promised  for  later  publication.  We  observe  the  rather  curious,  not 
to  say  crotchety,  selection  of  tests.  This  display  of  originality,  however,  led  to  at  least 
one  fortunate  result,  namely,  the  inclusion  of  two  intelligence  tests  in  the  list.  This 
is  the  first  large  use  in  a  survey  of  such  tests.  The  results  of  these  tests,  if,  in  the  forth- 
coming publication,  they  are  properly  related  to  the  educational  tests,  will  constitute 
an  important  improvement  upon  conventional  methods  of  reporting. 

It  seems  to  us  that  the  work  of  the  Division  of  Tests  and  Measurements  forms  no 
integral  part  of  the  survey  which  the  Assembly  had  in  mind  when  it  created  the 
commission.    The  problem  was  distinctly  a  legislative  one.    What^Virginia  needs  more 
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than  anything  else  is  pennission  to  go  ahead  and  mandatory  laws  which  will  cut  away 
old  prejudices.  The  decision  to  test  the  schools  may  have  been  a  wise  one  from  another 
point  of  view,  but  it  seems  to  us  to  constitute  an  almost  entirely  separate  project. 

As  to  the  rest  of  the  report,  it  is,  as  we  have  intimated,  unusually  effective.  It 
"gets  across."  Unless  we  are  much  mistaken,  a  large  proportion  of  the  commission's 
program  will  be  enacted  into  law — this,  of  course,  unless  politics  play  an  unusually 
powerful  r61e.  The  price  of  $10,000  may  well  prove  infinitesimal  compared  with  the 
advantages. 

B.  R.  B. 

Manuel,  Herschel  T.  Talent  in  drawing.  (School  and  Home  Education  Monographs, 
No.  3.)  Bloomington,  Illinois:  Public  School  Publishing  Company,  1919.  152  pp. 
This  monograph  reports  a  study  of  gifted  children  made  in  1916-1917.  It  was 
subsidized  by  the  General  Education  Board  and  was  conducted  under  the  direction  of 
Professor  G.  M.  Whipple.  In  this  study  two  groups  of  important  related  problems 
were  recognized,  namely  (1)  those  pertaining  to  pupils  of  high  general  ability,  and 
(2)  those  pertaining  to  pupils  of  special  ability.  Dr.  Manuel's  book  has  to  do  with 
the  second  group  of  problems.  Its  scope  is  indicated  by  its  subtitle:  "An  experimental 
study  of  the  use  of  tests  to  discover  special  ability."  Pupils  of  special  ability  are 
defined  as  those  who  "by  endowment  or  by  training  are  so  equipped  as  to  take  special 
interest  in,  and  to  succeed  extraordinarly  well  with,  some  one  ability." 

The  present  study  proposes  to  consider  a  special  ability  (drawing)  with  reference 
to  two  problems: 

1.  What  are  the  essential  psychophysical  characteristics  of  persons  possessing 
talent  in  drawing? 

2.  How  may  the  test  method  be  used  in  the  diagnosis  of  such  talent? 

Forty-five  individual  tests,  mental  and  physical,  which  were  more  or  less  stand- 
ardized, were  used  with  nineteen  subjects  chosen  for  recognized  talent  in  drawing.  The 
subjects  were  distributed  as  follows:  coUege  or  university,  5;  secondary  school,  8; 
elementary  school,  6.  Biographical  and  personal  data  were  also  collected.  The 
test  results  are  presented  by  means  of  the  "psychograph"  or  "profile"  showing  graphi- 
cally the  performances  of  each  subject  in  several  tests  as  compared  with  standard 
performances.  This  method  of  representing  the  statistical  data  derived  from  psy- 
chological tests  is  especially  useful  for  diagnostic  purposes. 

As  to  the  first  problem — the  characteristics  of  those  talented  in  drawing — the 
following  abilities  seem  closely  related  to  ability  in  drawing:  Mentally  to  note  a  visual 
form  and  to  reproduce  it;  to  observe;  to  select  from  a  complex  visual  situation  the  most 
representative  and  the  most  beautiful  aspects;  to  remember  visual  forms;  to  manipu- 
late them  mentally;  to  control  hand  movements  in  accordance  with  visual  percept  or 
image;  to  invent — i.e.,  to  bring  together  into  new  artistic  combinations  the  elements 
of  different  visual  experiences;  to  judge  the  beautiful  in  line,  form,  color,  and  composi- 
tion; and  to  discriminate  differences  in  color  and  in  visual  magnitude.  Acuity  of  vision, 
interest  in  the  act  and  products  of  drawing,  and  general  intelligence  are  likewise 
characteristics  of  those  talented  in  drawing. 

As  to  the  second  problem — the  diagnosis  of  talent  in  drawing — naturally  tests 
of  the  foregoing  abilities  are  the  ones  selected  from  the  entire  forty-five  as  having 
highest  diagnostic  value.    These  are  described  and  references  are  given  indicating 
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where  they  may  be  found.  It  is  recommended  that  tests  be  arranged  to  ascertain 
not  only  the  strength  of  an  ability  but  also  its  improvability.  The  so-called  "in- 
structed-learning"  method  is  therefore  advised.  Finally,  the  author  notes  that  "the 
measurement  of  many  different  abilities  not  primarily  related  to  drawing  is  necessary 
to  the  most  effective  educational  and  vocational  use  of  measurement  of  ability  in 
drawing." 

While  it  has  not  been  the  purpose  of  the  author  in  this  study  to  prepare  material 
and  standards  for  the  recommended  tests,  he  promises  a  further  contribution  of  this 
nature.  His  limitations  due  to  lack  of  standards  is  evident  throughout,  but  we  trust 
the  one  who  has  made  so  thorough  an  investigation  of  this  particular  problem  will 
shortly  supply  the  supervisor  and  teacher  of  drawing  with  usable  tests  valuable  in 
determining  the  particular  talent. 

J.  Orin  Powers 

Murdoch,  Katharine.    The  measurement  of  certain  elements  of  hand  sewing.    (Teach- 
ers College  Contributions  to  Education,  No.  103.)    New  York:  Teachers  College, 
Columbia  University,  1919..  120  pp. 
The  scope  of  this  monograph  is  well  described  by  the  following  statement  of  the 

author: 

"The  specific  tasks  of  this  research  are  as  follows : 

1.  To  make  a  scale  by  means  of  which  merit  in  certain  forms  of  hand  sewing 
may  be  measured. 

2.  To  make  an  inventory  and  analysis  of  the  faults  found  in  children's 
sewing. 

3.  To  determine  the  relative  importance  of  various  faults  and  of  various 
stitches  as  indicators  of  general  merit  in  sewing. 

4.  To  determine  the  relative  reliability  of  judgments  concerning  various 
faults  and  concerning  various  stitches. 

5.  To  determine  (a)  the  reliability  of  one  or  more  samples  of  a  child's  sewing 
in  evaluating  her  real  ability  in  that  kind  of  sewing;  to  determine  (b)  the  number 
of  samples  of  various  stitches  which  would  be  required  in  order  to  have  various 
degrees  of  probability  that  a  child's  real  ability  to  execute  that  particular  stitch 
was  measured. 

6.  To  determine  the  relative  accuracy  of  competent  persons,  with  varying 
degrees  of  knowledge  about  sewing  and  the  teaching  of  sewing,  as  judges  of  sewing 
products. 

7.  To  test  the  value  of  our  sewing  scale  as  a  means  of  attaining  greater  exac- 
titude in  the  grading  of  sewing  products." 

As  a  preliminary  step  in  constructing  the  scale  for  measuring  certain  elements  of 
hand  sewing,  samples  of  the  hand  sewing  of  1,212  individuals  were  secured.  These 
samples  are  called  samplers.  They  were  uniform  as  to  material  and  kinds  of  stitches. 
In  quality  they  ranged  from  the  samplers  contributed  by  37  children  who  were  in 
special  classes  for  defectives  or  in  institutions  for  the  feeble-minded  to  samplers 
contributed  by  adults  who  were  judged  to  be  expert  hand  sewers.  From  these  samples 
of  hand  sewing  IS  samplers  were  finally  selected,  which,  on  the  basis  of  the  judgments 
of  competent  judges,  range  in  quality  from  0  to  16.4.  The  method  of  selection  and  of 
determining  the  scale  values  follows  closely  that  originally  used  by  Thomdike  in  the 
field  of  handwriting  and  drawing.    Each  unit  "represents  that  amount  of  merit  which 
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exists  between  the  samplers  when  one  is  recognized  as  being  of  more  value  than  the 
other  by  75  per  cent  of  competent  judges  and  of  less  value  than  by  the  other  25  per 
cent  of  the  judges."  "Zero  was  arbitrarily  defined  as  meaning  the  score  to  be  given  a 
sampler  which  could  be  recognized  as  an  attempt  to  conform  to  the  directions  for  the 
making  of  the  sampler,  but  which  had  absolutely  no  merit  as  an  example  of  the  stitches 
indicated."  On  the  basis  of  this  definition  of  zero,  38  of  the  80  judges  said  that  the 
sampler  finally  chosen  to  represent  zero,  represented  zero,  21  judges  considered  it 
better  than  zero,  and  21  judges  considered  it  worse  than  zero.  This  sampler  was 
contributed  by  an  imbecile  boy  "untrained  in  sewing  who  is  particularly  deficient  in 
motor  control  and  who  suffers  from  serious  eye  trouble  which  often  causes  dizziness 
and  nausea." 

Each  of  the  samplers  contains  five  kinds  of  stitches:  combination,  running,  over- 
casting, hemming,  and  backstitch.  Half-tone  reproductions  have  been  made  of  the 
fifteen  samplers  chosen  for  the  final  scale.  Three  views  are  given  of  each  sampler  in 
such  a  way  that  all  of  the  sewing  is  represented.  Thus  the  final  scale  as  made  available 
for  general  use  consists  of  half-tone  reproductions  of  the  fifteen  samplers  made  in  such 
a  way  that  all  of  the  sewing  is  clearly  shown. 

The  construction  of  the  scale  was  supplemented  by  the  analysis  of  the  faults  in 
the  stitches  involved  in  these  samples  of  hand  sewing.  The  list  of  faults  was  finally 
reduced  to  23  in  number  and  the  relation  of  these  to  general  merit  was  studied.  This 
work  supplements  the  scale  in  a  very  significant  way.  It  is  particularly  valuable  in 
assisting  in  the  interpretation  of  measures  in  terms  of  the  pupil  needs. 

In  the  study  of  the  reliability  of  the  measures  yielded  by  the  scale  there  are  two 
significant  findings.  When  it  was  used  to  measure  the  quality  of  the  hand  sewing 
in  completed  articles  such  as  aprons  and  bags,  it  was  found  that  the  measures  assigned 
by  different  judges  were  less  variable  than  when  isolated  hand  sewing  on  samplers 
similar  to  those  of  which  the  scale  was  made  was  measured.  This  finding  shows  that 
it  is  feasible  to  use  the  scale  in  measuring  the  hand  sewing  done  in  making  real  things. 
The  second  finding  was  that  judgments  of  different  teachers,  based  upon  the  use  of 
the  scale,  were  found  to  be  less  variable  and  hence  more  accurate  than  judgments 
made  without  the  scale,  although  only  teachers  from  a  single  large  high  school  were 
used  in  this  experiment  and  were  untrained  in  the  use  of  the  scale. 

The  most  significant  features  of  Miss  Murdoch's  work  are  the  ways  in  which  she 
has  supplemented  the  usual  scale  derivation.  The  time  is  rapidly  approaching,  if 
it  has  not  already  arrived,  when  new  measuring  instruments  will  receive  little  con- 
sideration until  scientific  evidence  concerning  their  usefulness  is  made  available. 
Already  it  is  being  urged  by  some  that  each  measuring  instrument  should  be  accom- 
panied by  a  definite  statement  concerning  its  reliability  and  validity.  Miss  Murdoch 
is  one  of  the  first,  if  not  the  first,  to  accompany  the  account  of  the  derivation  of  a 
scale  with  a  statement  of  the  reliability  of  the  scores  that  are  obtained  by  using  it. 
Furthermore,  as  stated  above  she  demonstrates  that  the  scale  can  be  successfully 
used  in  judging  the  hand  sewing  on  completed  articles  of  a  rather  complex  nature. 

The  scale  has  yet  to  be  standardized  and  there  is  not  contained  in  the  monograph 
sufi&cient  directions  to  guide  a  teacher  in  using  it.  It  is  to  be  hoped  that  in  making 
the  scale  itself  available  to  teachers,  detailed  directions  for  using  it  as  well  as  record 
sheets  for  the  tabulating  of  the  results  will  be  provided. 

W.  S.  M. 
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Henry,  Theodore  S.    Classroom  problems  in  the  education  of  gifted  children.     (Nine- 
teenth Yearbook  of  the  National  Society  for  the  Study  of  Education.)    Blooming- 
ton,  Illinois:  Public  School  Publishing  Co.,  1920.     125  pp. 
For  a  long  time  there  has  been  in  this  country  some  recognition  of  the  necessity 
of  meeting  the  needs  of  pupils  of  marked  ability  in  such  a  way  as  to  give  them  oppor- 
tunity for  more  rapid  advancement  than  that  of  the  average  pupil.    The  great  and 
hitherto  unsuspected  individual  differences  revealed  by  the  recent  widespread  applica- 
tion of  mental  and  educational  tests  are  fast  pushing  this  subject  to  the  forefront  of 
attention. 

In  this  monograph  the  National  Society  for  the  Study  of  Education  has  once 
more  made  an  important  and  timely  contribution  to  the  science  of  education.  The 
study  is  the  report  of  the  results  of  an  experiment  in  which  pupils  selected  on  the 
basis  of  their  excellence  in  school  work  were  placed  under  special  instruction.  It 
includes  a  summary  of  the  various  schemes  for  flexible  promotion  which  have  been 
tried  out  in  this  country,  and  a  description  of  the  types  of  special  classes  that  have 
been  established  for  gifted  pupils.  In  addition,  there  is  a  chapter  on  the  methods  of 
teaching  which  are  especially  adapted  to  the  instruction  of  this  class  of  children,  and 
a  bibliography  covering  the  general  field. 

The  number  of  pupils  selected  for  the  experiment  which  was  carried  out  in  one 
of  the  public  schools  of  Urbana,  Illinois,  was  thirty — fifteen  from  the  fifth  and  fifteen 
from  the  sixth  grade.  The  attempt  was  made  to  carry  out  the  experiment  under 
average  conditions  of  schoolroom  instruction.  "Supervision,  course  of  study,  physical 
equipment  of  room  and  of  building,  instruction — none  of  these  could  be  said  to  be 
above  average."  The  remaining  fifth-  and  sixth-grade  pupils  of  the  school  were  used 
throughout  the  experiment  as  a  control  group.  The  intelligence  quotients  of  the 
members  of  the  special  school  as  measured  by  the  Terman  revision  of  the  Binet-Simon 
Scale  ranged  from  99.3  to  146.6.  It  appears,  therefore,  that  on  the  basis  of  these 
tests  there  were  pupils  in  the  special  class  who  did  not  belong  there.  Indeed,  if  the 
author's  recommendation  were  adopted  that  a  minimal  I.  Q.  of  115  be  the  standard 
for  admission  to  such  special  classes,  it  would  rule  out  fourteen  of  the  thirty  pupils 
of  this  special  class.  Notwithstanding  this  handicap  the  special  class  was  able  to  do 
the  work  of  two  grades  in  one  year,  and  seventeen  pupils  secured  corresponding  pro- 
motion at  the  end  of  the  school  year  on  the  basis  of  the  regular  examinations.  Almost 
all  of  the  remaining  pupils  passed  special  examinations  after  review  work  during  the 
summer  and  thus  secured  promotion.  Educational  tests  given  throughout  the  year 
showed  that  by  May  first  the  pupils  had  actually  gained  a  year  as  measured  by  these 
scales. 

The  interpretation  of  the  results  of  such  an  experiment  is  necessarily  somewhat 
difiacult.  There  is  no  way  of  determining  to  what  extent  the  more  rapid  progress  of 
these  pupils  is  due  to  the  special  conditions  under  which  they  were  placed  rather  than 
to  their  superior  abilities.  As  the  author  points  out,  practically  all  the  methods 
adapted  to  the  instruction  of  the  specially  gifted  are  equally  applicable  in  the  teaching 
of  the  average  pupil.  It  is  difl&cult  to  say  how  much  more  rapid  the  advancement 
of  the  control  group  might  have  been  if  it  had  had  the  advantage  of  the  same  special 
attention,  and  especially  if  the  same  spur  to  ambition  had  been  provided.  The  success 
of  a  large  number  of  pupils  of  only  average  intelligence  in  gaining  promotion  seems  to 
show  that  these  factors  were  more  important  than  the  author  believes. 

Edward  H.  Cameron 
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This  department  will  contain  news  items  regarding  research  workers 
and  their  activities.  It  will  also  serve  as  a  clearing  house  for  more  formal 
communications  on  similar  topics,  preferably  of  not  more  than  five  hundred 
words.  These  communications  will  be  printed  over  the  signatures  of  the 
authors.  Address  all  correspondence  concerning  this  department  to  Walter 
S.  Monroe,  University  of  Illinois,  Urbana,  Illinois. 


One  of  the  latest  additions  to  the  rapidly  increasing  group  of 
West  Virginia  state  educational  institutions  which  have  established  a  bureau 
University  Bureau  of  educational  research  is  West  Virginia  University.  In  a  recent 
of  Educational  circular  they  announce  the  establishment  of  the  bureau  and  give 
Research  the  prices  of  a  number  of  educational  tests  and  the  addresses  from 

which  they  can  be  obtained. 

In  1917  Dr.  Albert  Shiels,  then  superintendent  of  schools,  recommended  the 
establishment  of  two  new  departments.  Accordingly  a  Division  of  Educational  Re- 
Department  of  search  was  established  in  charge  of  Mr.  Robert  H.  Lane,  who 
Psychology  and  as  a  principal  of  one  of  the  elementary  schools  had  attracted 
Educational  Re-  attention.  Also,  a  Division  of  Psychology  was  created  and 
search  at  Los  Dr.  A.  H.  Sutherland  was  invited  to  begin  some  studies  on 
Angeles,  California  types  of  children.  In  1920  Mr.  Robert  H.  Lane  was  elevated 
to  an  assistant  superintendency  and  thereby  rewarded  for 
meritorious  service. 

During  the  past  two  years  comments  have  not  been  lacking  that  the  work  of  the 
divisions  overlaps.  It  was  therefore  decided  to  bring  the  two  divisions  together  under 
the  temporary  name  of  the  Department  of  Psychology  and  Educational  Research 
with  Dr.  A.  H.  Sutherland  as  director.  The  new  department  is  to  continue  the  func- 
tions previously  served  by  both  divisions.  It  will  have  charge  of  the  giving  and 
training  teachers  to  give  standardized  educational  tests  and  the  collection  and  tabula- 
tion of  statistical  information.  It  will  also  have  charge  of  the  segregation  of  types  of 
children  and  the  direction  of  the  special  rooms  for  backward  children. 

Mr.  H.  C.  Daley,  Survey  Department,  Highland  Park,  Michigan,  sends  the 
following  tabulation  of  the  results  of  giving  Monroe's  Standardized  Silent  Reading 
An  Experiment  Test  in  the  seventh  and  eighth  grades.  Form  3  was  given  on  Sep- 
in  Silent  tember  19,  1919,  and  Form  2  on  January  28,  1920.     "After  the 

Reading  September  testing  pupils  were  reclassified  into  strong  and  weak 

sections  in  accordance  with  the  results  of  the  tests.  In  several  cases 
capable  pupils  were  transferred  to  a  higher  grade."  This  shifting  would  tend  to  reduce 
the  standing  of  the  groups.    In  spite  of  this,  all  groups  show  remarkable  gains. 

This  use  of  two  different  forms  of  this  test  raises  the  question  of  the  equivalence 
of  the  forms.    Although  the  different  forms  were  constructed  so  that  they  would  yield 
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equivalent  comprehension  scores,  a  recent  study  of  the  different  forms  shows  that  this 
was  not  accomplished  in  all  cases.  However,  the  best  data  available  at  this  time 
indicate  that  Forms  2  and  3  are  equivalent  for  comprehension  in  the  seventh  and 
eighth  grades.  They  are  not  equivalent  with  respect  to  rate.  The  rate  scores  on  Form 
2  may  be  expected  to  be  fifteen  to  twenty  words  higher  than  on  Form  3.  Thus  the 
non-equivalence  of  the  two  forms  used  probably  accounts  for  a  portion  of  the  gain  in 
rate  but  it  does  not  account  for  any  of  the  gain  in  comprehension. 


Grade 

No.  OF 
Children 

Rate 

Comprehension 

Sept. 

Jan. 

Sept. 

Jan. 

Sept. 

Jan. 

Low  seventh 

High  seventh 

Low  eighth 

High  eighth 

252 
170 
199 
156 

205 
136 
161 

285 

102 
103 
101 
104 

118 
134 
135 
124 

21 
22 
21 
24 

27 
28 
28 
28 

Number  of  Pupils: 

Low  Seventh 

HighSeventh 

Low  Eighth 

High  Eighth 

Sept. 

Jan. 

Sept. 

Jan. 

Sept. 

Jan. 

Sept. 

Jan. 

Above    rate    130    words 

per  minute 

39 

96 

22 

72 

23 

93 

29 

95 

Below  rate  75  words  per 

minute 

29 

14 

29 

2 

36 

4 

16 

16 

Above  comprehension  of 
30 

35 

76 

27 

53 

42 

68 

48 

115 

Below  comprehension  of 
11 

44 

2 

14 

1 

29 

3 

9 

9 

The  twenty-eighth  annual  meeting  of  the  American  Psychological  Association, 
held  at  Harvard  University,  December  29,  30,  and  31,  1919  was  attended  by  more 

than  150  workers  in  psychology  and  allied  fields.    Joint  sessions  were 
American  held  with  the  American  Anthropological  Association  and  the  Amer- 

Psychological    ican  Association  of  Clinical  Psychologists  and  provisions  were  made 
Association        for  inspection  of  the  Massachusetts  State  School  for  Feeble-Minded, 

the  Judge  Baker  Foundation,  the  Carnegie  Nutrition  Laboratory, 
McLean  Hospital,  the  Psychopathic  Hospital  and  other  local  institutions. 

Shepherd  I.  Franz,  Government  Hospital  for  the  Insane,  Washington,  D.  C,  was 
elected  president  of  the  Association  for  1920;  H.  S.  Langfeld,  Harvard  University, 
and  W.  V.  Bingham,  Carnegie  Institute  of  Technology,  were  elected  to  the  council. 
Chicago  was  elected  for  the  convention  in  December,  1920.  Twenty-seven  new  mem- 
bers were  voted  into  the  association  and  the  deaths,  during  the  year,  of  John  Wallace 
Baird,  Edward  Cowles,  and  August  Hoch  were  reported. 

A  committee  consisting  of  Bird  T.  Baldwin,  University  of  Iowa  (Chairman); 
W.  F.  Dearborn,  Harvard  University;  L.  S.  HoUingworth,  Teachers  College;  B.  Ruml, 
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The  Scott  Co.,  Philadelphia;  and  Helen  T.  Wooley,  Vocational  Bureau,  Public  Schools, 
Cincinnati,  Ohio,  were  appointed  to  consider  the  legal  and  professional  status  of 
"clinical  psychologists."  The  N.E.A.  at  its  last  meeting  passed  a  resolution  to  the 
effect  that  the  diagnosis  and  segregation  of  defective  children  should  be  in  the  hands  of 
highly  trained  and  certified  psychologists  only;  a  similar  resolution  being  adopted  by 
the  Educational  Conference  held  at  Albany,  N.  Y.,  in  May  1919.  The  committee 
listed  above  is  now  engaged  in  (1)  determining  the  qualifications  of  a  clinical  psy- 
chologist and  in  suggesting  means  of  establishing  and  promoting  an  adequate  profes- 
sional curriculum;  (2)  investigating  the  methods  of  legal  certification  now  operating 
in  the  states;  (3)  compiling  data  on  the  legal  aspects  of  clinical  work — the  acceptance 
of  testimony  of  a  psychologist  in  court,  commitments,  etc.;  (4)  drawing  up  plans 
whereby  the  American  Psychological  Association  may  issue  certificates  to  "clinical 
psychologists"  and  (5)  determining  the  qualifications  for  psychological  workers  in 
industry. 

The  program  of  the  session  gave  6  titles  under  general  psychology,  experimental 
psychology  16,  intelligence  tests,  educational  and  clinical  psychology  21,  comparative 
psychology  2,  social  and  religious  psychology  3,  and  applied  psychology  7.  The  pro- 
nounced development  of  the  technic  of  trade  testing,  the  thorough  tryout  of  intelligence 
tests  by  their  use  on  more  than  a  million  and  a  half  recruits,  bringing  up  the  question 
of  revision  of  older  notions  of  median  mental  levels  of  unselected  as  well  as  psycho- 
neurotic, foreign-born,  colored  and  other  individuals,  the  need  of  tests  other  than  those 
of  general  intelligence  for  diagnosis  of  psychoneurotics,  vocational  aptitudes  and  re- 
tardation in  schools,  the  need  of  systematic  training  and  classification  of  workers  in 
the  rapidly  growing  field  of  clinical  psychology  and  the  use  of  individual  and  group 
tests  in  diagnosis  and  prognosis  of  ability  in  school  functions,  may  be  considered  the 
main  features  of  the  meetings. 

The  papers  were  so  numerous  and  so  varied  in  content,  that  no  attempt  will  be 
made  here  to  allude  more  than  briefly  to  those  which  bear  closely  upon  educational 
topics. 

The  address  of  the  retiring  president,  Walter  Dill  Scott,  Northwestern  University, 
on  the  topic  "Changes  in  Some  of  Our  Conceptions  and  Practises  in  Personnel"  gave  a 
survey  of  progress  in  educational  theory  and  practice.  Evolution  along  five  lines  was 
emphasized:  (1)  A  history  was  given  of  changes  in  the  concept  of  the  amount  and 
nature  of  individual  differences  from  the  older  belief  that  peoples  were  originally 
much  alike  and  that  such  differences  as  appeared  were  due  to  environmental  factors 
to  the  present  belief  that  individuals  differ  enormously  in  all  traits  and  that  such 
differences  are  largely  innate.  "The  greatest  achievement  of  the  association  has  been 
the  establishment  of  the  fact  of  individual  differences  and  its  applications  to  educa- 
tion, politics,  industry,  and  economics." 

(2)  The  importance  of  reasoning  as  a  factor  in  adjustments  has  been  superseded 
by  the  consideration  of  instincts,  emotions,  and  habits.  The  operation  of  instinctive 
trends  as  the  spring  of  action  and  the  sources  of  discontent  in  industrial  life  was 
illustrated  by  concrete  cases.  It  is  not  the  violation  of  the  worker's  logical  processes 
that  brings  unrest  and  discontent  so  much  as  thwartings  of  his  pride,  his  desire  of  social 
approval,  of  mastery,  and  his  instinctive  and  emotional  trends. 

(3)  Education  in  the  schools  or  in  the  factory  must  take  into  account  the  unlearned 
forms  of  reaction  to  features  of  the  enviroimaent  and  seek  to  so  order  the  individual 
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and  his  environment  that  the  desirable  adjustments  may  be  made.  The  work  of  the 
personal  director  in  industry  must  be  enlarged  and  his  function  must  be  that  of  pro- 
viding the  approved  experiences  so  that  desirable  habits  of  response  will  be  built  up. 
Mere  richness  of  content  or  training  of  general  faculties  will  not  suffice. 

(4)  Changes  have  taken  place  in  the  concept  of  man  and  his  envirorunent.  A  man 
is  not  the  victim  of  his  environment,  he  is  not  the  master  of  it  nor  is  his  function  that 
of  subduing  or  opposing  it.  The  two  should  evolve  together.  In  industry,  the  man 
and  his  job  are  not  opposed,  nor  does  the  concept  of  selecting  the  man  to  fit  the  job — 
finding  a  square  peg  for  a  square  hole — adequately  express  the  present  point  of  view. 
The  function  of  the  personnel  manager  is  the  "creation  of  the  worker  in  a  working 
situation."  The  work  must  be  arranged  to  satisfy  the  human  wants  of  the  worker 
and  he  should  be  set  to  the  task  most  in  harmony  with  his  particular  talents  and 
interests.     There  must  be  a  correlated  improvement  of  the  work  and  the  workers. 

(5)  The  last  point  led  to  a  survey  of  the  evolution  of  vocational  guidance  from 
the  chance  methods  of  superstition,  guess,  and  incidental  inclinations  to  the  modem 
technic  to  mental,  physical,  and  vocational  tests,  statistical  methods  and  the  like. 
"In  the  last  century  the  productivity  of  the  worker  has  been  doubled  by  the  activities 
of  some  2,000  minds  through  changes  in  the  material  world.  In  the  present  century 
equally  great  increases  in  productivity  may  be  expected  through  the  adjustment  of 
worker  to  the  work." 

Following  are  brief  summaries  of  papers,  presented  in  the  various  sessions,  which 
may  be  of  interest  to  workers  in  education. 

A  most  valuable  and  practical  method  of  evaluating  school  attainments  in  terms 
of  mental  ability  is  the  result  of  studies  by  Rudolf  Pintner  of  Ohio  State  University. 
A  mental  test  alone  is  not  sufficient  to  diagnose  a  child  accurately;  measures  of  school 
attainment  based  on  both  age  and  grade  norms  are  needed.  Two  survey  tests,  one 
mental  and  one  educational,  were  devised  and  applied  to  1,500  cases.  Percentile 
values  are  converted  into  a  so-called  "index"  ranging  from  zero  to  one  hundred. 
The  median  indices  serve  as  a  measure  for  the  school.  A  high  mental  age  with  low 
educational  index  indicates  deficiencies  in  instruction,  whereas  a  close  agreement 
between  the  two  indices  indicates  efficiency  in  the  school.  In  the  same  way  different 
classes  in  the  same  school  or  different  individuals  in  the  same  class  may  be  compared, 
enabling  one  to  correlate  innate  ability  with  possible  attainment  and  to  apply  correc- 
tive measures  when  the  need  appears. 

E.  A.  Doll,  Princeton  University,  presented  data  obtained  from  intelligence 
tests  of  a  million  and  a  half  army  recruits  and  other  subjects  bearing  upon  the  median 
mental  age  of  adults,  commonly  assumed  to  be  about  16  years  for  unselected  groups. 
The  Stanford-Binet  median  mental  age  equivalent  of  army  recruits  is  13  years;  of 
negro  and  foreign-born  recruits  10  years;  of  adult  male  state  prisoners  13  years,  the 
actual  tests  used  in  each  case  being  the  Army  Alpha.  Five  hundred  typical  public 
school  children  examined  by  Alpha  show  no  increase  in  median  scores  by  age  after  13, 
the  same  being  true  of  juvenile  delinquents,  ages  16  to  30  years.  From  these  data 
the  suggestion  was  made  that  the  median  mental  age  level  of  native  white  adults  is 
approximately  13  years.  No  attempt  was  made  to  determine  the  life  age  limit  of 
mental  growth,  since,  it  was  suggested,  "emotional  development,  skill,  acquisition, 
aptitudes  and  the  like  probably  continue  to  develop  indefinitely."  The  upper  age 
limit  of  feeblemindedness  is  not  coincident  with  the  lower  mental  age  limit  of  nor- 
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mality,  since  it  appeared  that  the  borderline  zone  for  feeblemindedness  may  cover 
a  range  from  mental  age  7  to  13  years.  The  application  of  mental  age  or  I.  Q.  as 
criterion  of  mental  defect  is  specially  limited  in  the  case  of  individuals  of  10  or  more 
years  chronological  age.  Data  harmonizing  with  these  results  were  presented  by 
F.  L.  Wells  of  McLean  Hospital.  The  median  I.  Q.  (Stanford  scale)  of  102  cases 
of  mental  breakdown  at  McLean  is  88  but  I.  Q.'s  of  100  are  frequent  and  I.  Q.'s  of  119 
have  been  found  in  patients  conspicuously  incapable  of  self-maintenance.  Only  in 
organic  psychoses  does  the  breakdown  regularly  involve  the  ideational  capacities  with 
which  the  intelligence  scales  are  concerned.  Normal  and  even  superior  "intelligence" 
is  very  generally  associated  with  grave  judgment  and  conduct  disorder.  Intelligence 
scales  measure  essentially  ability  to  deal  with  ideas,  as  distinct  from  ability  to  deal 
with  things  or  with  people.  Psychotic  breakdowns  are  essentially  failures  of  adjust- 
ment to  the  social  environment.  The  speaker  emphasized  the  minor  r61e  of  "intelli- 
gence" (ideational  capacity)  in  mental  balance,  urging  a  conception  of  education  as  a 
discipline  of  character  rather  than  knowledge. 

With  a  few  changes,  the  Binet  tests  were  successfully  employed  by  S.  P.  Hayes, 
Mt.  Holyoke  College,  in  measuring  the  intelligence  of  the  blind.  A  modification  of  the 
Pressey  group  tests  also  gave  high  correlations  with  the  Binet  scores  and  abilities 
estimated  by  teachers.  E.  L.  Woods,  Wisconsin  State  Department  of  Public  Instruc- 
tion, reported  on  the  use  of  the  recently  devised  Virginia  tests  Alpha  in  group  testing 
of  intelligence  of  delinquent  girls.  J.  B.  Miner,  Carnegie  Institute  of  Technology, 
displayed  a  method  of  utilizing  three-dimensional  models  for  representing  individual 
differences  in  complex  abilities  such  as  salesmanship.  Certain  relations  not  now  taken 
care  of  in  frequency  tables,  correlations,  multiple  regression,  etc.,  can  be  displayed  by 
such  models. 

L.  W.  Webb,  Northwestern  University,  found  the  Pearson  coefficient  of  correla- 
tion between  rate  of  reading  (Monroe  Standardized  Silent  Reading  Test)  and  the 
Army  Alpha  and  Thurstone  Tests  A  and  B  ranging  from  -|-0.47  to  -|-0.59;  compre- 
hension of  reading  gave  coefficients  ranging  from  -j-0.48  to  4*0.69.  Speed  and  com- 
prehension of  reading  correlate  -|-0.85.  The  speaker  contended  that  these  correla- 
tions show  too  large  a  dependence  of  the  pencil  and  paper  tests  upon  rapidity  of 
comprehension  in  reading. 

L.  L.  Thurstone,  Carnegie  Institute  of  Technology,  found  the  cycle-omnibus 
form  of  intelligence  test  to  be  of  great  service  in  furnishing  data  for  recommending 
candidates  for  admission  to  engineering  colleges,  in  advising  committees  on  scholarship 
in  cases  of  delinquent  students,  and  in  giving  vocational  counsel.  S.  S.  Colvin,  of 
Brown  University,  reported  a  correlation  of  -|-0.60  between  success  in  the  Brown 
Intelligence  Tests  and  the  standing  in  college  for  the  first  two  years.  The  Thorndike 
tests,  first  used  in  1919,  proved  to  be  of  great  prognostic  value  and  showed  a  high 
correlation  with  itself  in  repeated  tests  on  the  same  subjects. 

D.  Mitchell,  Pelman  Institute,  defined  clinical  psychology  as  a  "professional  prac- 
tice" as  contrasted  with  the  "science"  of  laboratory  psychology.  Clinical  psychology 
was  again  contrasted  with  "applied  psychology"  largely  on  grounds  that  the  latter 
field  may  have  no  relation  to  the  individual.  Clinical  psychology  is  the  practise  of 
determining  mental  states  in  order  to  prescribe  kinds  and  methods  of  education,  of 
detecting  specific  abilities  and  disabilities  of  vocational  significance  and  the  manip- 
ulation of  emotional  development  for  desirable  social  reactions.    Dr.  Augusta  F. 
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Bronner,  Judge  Baker  Foundation,  emphasizing  the  function  of  clinical  psychology  as 
that  of  individual  diagnosis,  gave  illustrations  of  the  failure  of  general  intelligence 
tests  to  betray  significant  variations  in  mental  equipment.  The  necessity  of  devising 
tests  for  many  specific  abilities  was  urged.  Florence  Mateer,  Bureau  of  Juvenile 
Research,  has  found  that  whereas  the  mental  age  or  I.  Q.  are  of  little  value  in  the 
detection  of  psychopathic  conditions  due  to  syphilis,  a  detailed  account  of  the  range 
of  plus  and  minus  scores,  and  more  precise  measures  of  the  individual  responses  often 
give  a  reliable  clue  to  either  congenital  or  acquired  syphilis.  The  same  type  of  analysis 
generally  differentiates  the  psychopathic  from  the  non-psychopathic  no  matter  what 
the  mental  age  may  be. 

Tests  devised  to  measure  such  functions  as  persistence,  conscientiousness,  applica- 
tion and  emotional  control  are  being  applied  to  junior  high-school  and  other  students 
by  S.  L.  Pressey  of  Indiana  University.  Correlations  of  results  from  these  tests  with 
general  intelligence,  health,  and  estimates  of  intelligence  were  presented.  Mrs.  L.  W. 
Pressey,  Indiana  University,  urged  group  testing  of  general  intelligence  in  the  primary 
school  as  a  means  of  studying  the  effect  of  school  training  upon  tests  subsequently 
given.  Data  permitting  comparisons  of  test  findings  on  children  of  the  laboring  and 
professional  classes,  whites  and  negroes,  etc.,  were  presented.  E.  A.  Kirkpatrick, 
Fitchburg  State  Normal  School,  believes  that  normal  school  pupils  may  be  trained  in 
fifteen  hours  to  use  the  Binet  tests  in  classifying  pupils.  Less  time  is  required  to 
handle  group  tests,  but  much  more  is  needed  to  enable  the  student  to  score,  tabulate 
and  interpret  the  results.  Daniel  Starch,  University  of  Wisconsin,  found  in  data 
obtained  from  1,000  first-year  pupils,  that  approximately  equal  mental  ability  may 
exist  with  great  differences  in  language  ability.  Correlations  ranging  from  +0.25 
to  +0.28  between  interest  in  college  subjects  and  grades  received  in  them  were  found 
by  J.  W.  Bridges,  Ohio  State  University.  The  correlation  between  interest  and  the 
subject's  estimate  of  his  ability  in  the  courses  was  higher  +0.50  to  +0.59. 

From  data  obtained  in  several  extensive  investigations  cited  by  E.  L.  Thomdike, 
Teachers  College,  Columbia  University,  it  appears  that  even  experienced  judges  can 
not  treat  an  individual  as  a  compound  of  separate  qualities,  such  as  intelligence, 
industry,  technical  skill,  reliability,  etc.,  and  to  assign  a  magnitude  to  each  of  these  in 
independence  of  the  others.  The  correlations  between  such  traits  are  too  high  and 
too  even,  the  ratings  being  apparently  affected  by  a  marked  tendency  to  think  of  the 
person  in  general  as  rather  good  or  rather  inferior  and  to  be  influenced  in  all  judgments 
by  this  general  attitude.  It  was  suggested  that  observers  should  report  the  evidence,  not 
a  rating,  and  that  the  ratings  should  be  given  on  the  evidence  for  each  quality  separately. 

E.  G.  Boring,  of  Clark  University,  offered  several  cautions  concerning  the  uncriti- 
cal acceptance  of  the  distribution  of  mental  traits  according  to  the  normal  probability 
curve.  The  form  of  the  distribution  depends,  for  one  thing,  upon  the  unit  of  measure- 
ment adopted.  If  the  normal  law,  moreover,  is  the  law  of  chance,  then  two  mutually 
dependent  variables  for  which  the  relationship  is  not  simply  linear,  such  as  height  and 
volume  which  varies  roughly  as  its  cube,  cannot  have  the  same  form  of  chance  distribu- 
tion. If  the  distribution  for  height  is  normal,  the  distribution  for  volume  cannot 
possibly  be. 

W.  T.  Shepherd,  Washington,  D.  C,  in  a  study  of  148  children,  ages  eight  to 
thirteen  years,  emphasized  the  importance  of  the  educational  and  social  experiences, 
the  influence  of  respected  teachers  or  friends  upon  the  development  of  religious  ideals. 
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The  prevalent  belief  that  our  judgments  in  the  fields  of  appreciation  of  music  or 
literature  as  well  as  in  morals  are  considerably  influenced  by  the  contrary  opinions  of 
the  majority  of  experts  in  these  fields  is  supported  by  experimental  data  obtained  from 
college  students  by  H.  T.  Moore  of  Dartmouth  College.  Comparisons  with  control 
groups  yield  results  showing  that  the  knowledge  of  contrary  opinions  of  the  expert  or 
the  majority  produces  reversals  of  individual  opinions  in  matter  of  speech  amounting 
to  four  or  five  times  mere  chance.  Moral  reversals  under  majority  influence  are  4 . 7 
times  chance  whereas  reversals  of  musical  preferences  as  a  result  of  expert  or  majority 
opinion  is  about  twice  chance. 

Arthur  I.  Gates 
Teachers  College,  Columbia  University 

The  State  Department  of  Education  of  Colorado 
A  State-Wide  recently  decided  to  have  given  in  all  schools  of  the  state 
Use  of  Educa-     the  following  standardized  tests: 

tional  Tests         Courtis  Standard  Research  Tests  in  Arithmetic,    Series  B, 
Gray's  Oral  Reading  Test,   Gray's  Silent  Reading  Test, 
Ayres  Spelling  Scale,  Ayres  Handwriting  Scale,  "Gettysburg  Edition." 

At  the  present  time  the  University  of  Colorado  at  Boulder,  the  State 
Teachers  College  at  Greeley,  and  the  State  Normal  School  at  Gunnison,  are 
co-operating  in  conducting  extension  classes  for  Colorado  teachers.  For  the 
western  district  of  the  state  this  work  is  in  charge  of  Mr.  O.  B.  Staples  assisted 
by  Dr.  H.  T.  Manuel  and  Miss  Stella  Yowell.    Mr.  Staples  writes  as  follows: 

"The  County  Superintendents  have  been  asked  to  direct  this  work  (the 
testing  program),  and  while  they  are  struggling  with  it,  those  in  my  territory 
are  quite  unfamiliar  with  the  technique  of  the  work,  and  many  of  the  teachers 
scarcely  comprehend  the  significance  of  it,  some  of  them  not  so  much  as  ever 
having  heard  before  of  a  "Standard  Test."  But  this  action  of  the  State 
Department  has  given  the  work  large  publicity,  and  Dr.  Manuel  and  I  are 
cooperating  with  the  people  in  our  territory,  meeting  them  in  groups,  singly, 
etc.,  giving  them  such  instruction,  encouragement,  etc.,  as  we  can  to  help 
them  "put  over"  the  program  of  the  State  Department,  although  we  think  it 
is  being  attempted  in  a  very  crude  manner,  and  I  fear  somewhat  the  results 
may  not  be  very  helpful  for  a  time.  However,  it  is  a  start,  and  will  doubtless 
lead  to  something  definite  later. 

"In  our  course  we  are  using  Monroe's  Measuring  the  Results  of  Teaching 
as  a  text,  and  for  the  most  part  giving  to  the  teachers  themselves  most  of  the 
tests  discussed  in  this  book.  When  the  teachers  seem  familiar  with  a  given 
test  and  the  use  of  it,  we  have  them  give  it  in  their  schools  and  then  we  secure 
their  results,  discuss  them,  and  ask  them  to  apply  whatever  suggestions  we 
together  may  derive  from  such  procedure." 

The  state  normal  school  at  Gunnison  has  established  a  School  Service 
Bureau  which  is  serving  the  county  superintendents  and  teachers  of  the  state 
by  supplying  them  with  the  testing  material.  In  doing  so,  this  normal  school 
is  following  a  practice  which  has  been  found  exceedingly  worth  while  in  other 
states. 


(E.  J,  AsHBAUGH,  Secretary  and  Editor) 


Recently  in  talking  with  a  gentleman  who  is  greatly  interested  in  the  problems  of 
educational  research,  he  ventured  the  suggestion  that  most  of  our  bureaus  of  educa- 
tional research  were  misnamed.  He  stated  that  he  thought  they  should  be  named 
bureaus  of  accounting,  since  the  work  which  was  being  done  was  almost,  if  not 
entirely,  of  an  accounting  nature  rather  than  research. 

We  wonder  if  the  statement  is  true  and  if  there  is  not  a  suggestion  contained  therein 
which  will  be  beneficial  to  the  members  of  our  organization.  Let  each  director  of 
an  organized  bureau  of  educational  research  mentally  review  his  work  during  the  past 
year  and  consider  whether  or  not  it  has  been  research  or  merely  accounting.  Has 
status  alone  been  revealed?  Have  data  been  gathered,  tabulated,  and  presented  with- 
out careful  analysis  of  the  causal  factors  and  the  setting  up  of  a  definite  remedial 
program? 

We  feel  that  the  work  of  bureaus  of  educational  research  is  most  vital.  We  believe 
that  the  opportunities  are  practically  limitless.  We  believe,  also,  that  the  present  is 
critical  and  that  the  future  of  the  movement  for  organized  bureaus  rests  in  the  hands 
of  those  who  are  now  directing  such  work.  A  few  cities  have  established  such  bureaus 
and  discontinued  them  because  the  school  administration  did  not  feel  that  the  benefits 
derived  were  sufl&cient  to  justify  their  continuance.  At  this  stage  of  the  development 
of  the  movement  such  failure  is  almost  a  calamity.  Superintendents  and  teachers 
may  fail  and  the  schools  will  continue.  The  educational  world  is  accustomed  to  such 
failures.  But  we  must  not  fail.  We  must  not  only  discover  status  but  also  must  reveal 
tendencies  and  causes.  We  must  offer  to  the  classroom  teacher  and  the  supervisory 
force  definite  constructive  help  in  the  solution  of  the  problems  which  are  revealed 
by  measurement.  We  must  offer  the  administrators  well-conceived  programs  based 
upon  definite  data  which  can  [be  presented  to  school  boards  and  the  public.  We 
must  keep  the  scientific  attitude  but  speak  in  terms  of  common  knowledge.  We  must 
attack  minute  problems  and  carefully  control  conditions  in  our  experiments,  but  keep 
ever  in  mind  that  teachers  and  the  public  want  results  in  terms  of  the  larger  educa- 
tional progress. 

Unless  bureaus  of  research  can  modify  practice;  unless  they  can  offer  constructive 
help  all  along  the  line;  unless  they  can  make  teachers,  supervisors,  and  administrators 
feel  that  their  work  is  indispensable,  they  will  fail. 

But  we  shall  not  fail. 


The  applications  for  membership  of  four  persons  are  before  the  executive  commit- 
tee at  this  writing  and  others  are  going  through  the  preliminary  stage.  Interest  in  the 
work  of  the  association  is  certainly  growing.  Does  any  member  know  of  a  bureau 
an3rwhere  which  is  not  represented  by  membership?  If  so,  he  will  please  write  to  the 
secretary  at  once. 
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